[ 622.505896] env[70392]: INFO neutron.common.config [-] Logging enabled! [ 622.506249] env[70392]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43 [ 622.506550] env[70392]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=70392) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 622.506694] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 622.506800] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 622.507641] env[70392]: WARNING oslo_policy.policy [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 622.508133] env[70392]: WARNING oslo_policy.policy [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 622.509387] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] VMware NSXv3 Agent initialized successfully. [ 622.509757] env[70392]: DEBUG oslo_concurrency.lockutils [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] Acquiring lock "singleton_lock" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.509897] env[70392]: DEBUG oslo_concurrency.lockutils [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] Acquired lock "singleton_lock" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.510287] env[70392]: DEBUG oslo_concurrency.lockutils [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] Releasing lock "singleton_lock" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.510411] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] Full set of CONF: {{(pid=70392) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/eventlet/service.py:357}} [ 622.510624] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] ******************************************************************************** {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 622.510748] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] Configuration options gathered from: {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 622.510996] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 622.511328] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 622.511328] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] ================================================================================ {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 622.511458] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] agent_down_time = 75 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.511609] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] allow_automatic_dhcp_failover = True {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.511758] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] allow_bulk = True {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.511904] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] api_extensions_path = {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.512059] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] api_paste_config = api-paste.ini {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.512210] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] auth_strategy = keystone {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.512322] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] backdoor_port = None {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.512431] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] backdoor_socket = None {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.512575] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] backlog = 4096 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.512721] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] base_mac = fa:16:3e:00:00:00 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.512885] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] bind_host = 0.0.0.0 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.513045] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] bind_port = 9696 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.513193] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] client_socket_timeout = 900 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.513339] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] config_dir = [] {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.513528] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.513608] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] config_source = [] {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.513759] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] control_exchange = neutron {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.513909] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] core_plugin = ml2 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.514065] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] debug = True {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.514213] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] default_availability_zones = [] {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.514451] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.514580] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] dhcp_agent_notification = True {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.514764] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] dhcp_agents_per_network = 1 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.514847] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] dhcp_lease_duration = 86400 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.514985] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] dhcp_load_type = networks {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.515145] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] dns_domain = openstacklocal {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.515290] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.515430] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] enable_default_route_bfd = False {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.515612] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] enable_default_route_ecmp = False {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.515737] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] enable_dvr = True {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.515875] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] enable_new_agents = True {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.516108] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] enable_services_on_agents_with_admin_state_down = False {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.516163] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] enable_signals = True {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.516303] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] enable_traditional_dhcp = True {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.516449] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] external_dns_driver = None {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.516602] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] filter_validation = True {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.516771] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] global_physnet_mtu = 8950 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.516919] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] graceful_shutdown_timeout = 60 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.517116] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] host = cpu-1 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.517266] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] host_dvr_for_dhcp = True {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.517446] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] http_retries = 3 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.517550] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] instance_format = [instance: %(uuid)s] {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.517696] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.517843] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] ipam_driver = internal {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.517982] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] ipv6_pd_enabled = False {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.518132] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] l3_ha = False {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.518301] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.518412] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] l3_ha_network_physical_name = {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.518554] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] l3_ha_network_type = {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.518730] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] log_color = False {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.518864] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] log_config_append = None {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.519015] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.519159] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] log_dir = None {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.519296] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] log_file = None {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.519407] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] log_options = True {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.519550] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] log_rotate_interval = 1 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.519736] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] log_rotate_interval_type = days {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.519889] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] log_rotation_type = none {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.520009] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.520125] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.520269] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.520410] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.520520] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.520662] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] max_dns_nameservers = 5 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.520818] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] max_header_line = 16384 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.520931] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] max_l3_agents_per_router = 3 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.521078] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] max_logfile_count = 30 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.521215] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] max_logfile_size_mb = 200 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.521350] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] max_subnet_host_routes = 20 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.521492] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] my_ip = 10.180.1.21 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.521636] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] my_ipv6 = ::1 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.521767] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] network_auto_schedule = True {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.521896] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] network_link_prefix = None {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.522046] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.522191] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] notify_nova_on_port_data_changes = True {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.522332] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] notify_nova_on_port_status_changes = True {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.522474] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] pagination_max_limit = -1 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.522610] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] publish_errors = False {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.522747] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] rate_limit_burst = 0 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.522888] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] rate_limit_except_level = CRITICAL {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.523033] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] rate_limit_interval = 0 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.523175] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] retry_until_window = 30 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.523309] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] router_distributed = False {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.523444] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] rpc_resources_processing_step = 20 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.523582] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] rpc_response_max_timeout = 600 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.523944] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] rpc_response_timeout = 60 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.523944] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] send_events_interval = 2 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.524091] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] service_plugins = ['router'] {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.524143] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] setproctitle = on {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.524279] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] shell_completion = None {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.524418] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] state_path = /opt/stack/data/neutron {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.524556] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] syslog_log_facility = LOG_USER {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.524731] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] tcp_keepidle = 600 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.524833] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] transport_url = **** {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.524971] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] use_journal = False {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.525119] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] use_json = False {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.525254] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] use_ssl = False {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.525388] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] use_stderr = False {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.525556] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] use_syslog = False {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.525706] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] vlan_qinq = False {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.525845] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] vlan_transparent = False {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.525979] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] watch_log_file = False {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.526131] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] wsgi_default_pool_size = 100 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.526266] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] wsgi_keep_alive = True {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.526409] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.526601] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] wsgi_server_debug = False {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 622.526694] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] oslo_concurrency.disable_process_locking = False {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.526846] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.526995] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.527149] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.527295] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] oslo_messaging_metrics.metrics_process_name = {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.527441] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.527584] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.527739] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] profiler.connection_string = messaging:// {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.527886] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] profiler.enabled = False {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.528043] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] profiler.es_doc_type = notification {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.528190] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] profiler.es_scroll_size = 10000 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.528335] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] profiler.es_scroll_time = 2m {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.528475] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] profiler.filter_error_trace = False {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.528621] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] profiler.hmac_keys = **** {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.528766] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] profiler.sentinel_service_name = mymaster {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.528914] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] profiler.socket_timeout = 0.1 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.529064] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] profiler.trace_requests = False {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.529232] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] profiler.trace_sqlalchemy = False {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.529352] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] profiler_jaeger.process_tags = {} {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.529513] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] profiler_jaeger.service_name_prefix = None {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.529623] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] profiler_otlp.service_name_prefix = None {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.529773] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] oslo_policy.enforce_new_defaults = True {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.530066] env[70392]: WARNING oslo_config.cfg [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 622.530227] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] oslo_policy.enforce_scope = True {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.530377] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] oslo_policy.policy_default_rule = default {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.530532] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.530684] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.530832] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.530974] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.531129] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.531271] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.531402] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.531554] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] oslo_policy.remote_timeout = 60.0 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.531758] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.531921] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] agent.extensions = [] {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.532085] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.532236] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] service_providers.service_provider = [] {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.532386] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] QUOTAS.default_quota = -1 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.532752] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.532752] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] QUOTAS.quota_floatingip = 50 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.532847] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] QUOTAS.quota_network = 100 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.532944] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] QUOTAS.quota_port = 500 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.533096] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] QUOTAS.quota_rbac_policy = 10 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.533280] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] QUOTAS.quota_router = 10 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.533397] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] QUOTAS.quota_security_group = 10 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.533582] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] QUOTAS.quota_security_group_rule = 100 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.533746] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] QUOTAS.quota_subnet = 100 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.533889] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] QUOTAS.track_quota_usage = True {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.534056] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.534201] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] privsep.group = None {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.534340] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] privsep.helper_command = None {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.534484] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] privsep.logger_name = oslo_privsep.daemon {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.534626] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] privsep.thread_pool_size = 8 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.534772] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] privsep.user = None {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.534968] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.535059] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] privsep_dhcp_release.group = None {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.535194] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] privsep_dhcp_release.helper_command = None {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.535335] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.535473] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.535631] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] privsep_dhcp_release.user = None {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.535782] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.535920] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] privsep_ovs_vsctl.group = None {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.536068] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] privsep_ovs_vsctl.helper_command = None {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.536213] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.536353] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.536489] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] privsep_ovs_vsctl.user = None {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.536636] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] privsep_namespace.capabilities = [21] {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.536770] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] privsep_namespace.group = None {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.536904] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] privsep_namespace.helper_command = None {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.537055] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.537208] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] privsep_namespace.thread_pool_size = 8 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.537335] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] privsep_namespace.user = None {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.537481] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] privsep_conntrack.capabilities = [12] {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.537619] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] privsep_conntrack.group = None {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.537757] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] privsep_conntrack.helper_command = None {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.537898] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.538063] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] privsep_conntrack.thread_pool_size = 8 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.538202] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] privsep_conntrack.user = None {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.538351] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] privsep_link.capabilities = [12, 21] {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.538488] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] privsep_link.group = None {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.538625] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] privsep_link.helper_command = None {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.538767] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.538906] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] privsep_link.thread_pool_size = 8 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.539050] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] privsep_link.user = None {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.539209] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.539359] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.539502] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] AGENT.continue_on_failed_promotions = False {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.539645] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] AGENT.dscp = None {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.539783] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] AGENT.dscp_inherit = False {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.539928] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] AGENT.force_mp_to_policy = True {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.540075] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] AGENT.locking_coordinator_url = None {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.540219] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] AGENT.log_agent_heartbeats = False {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.540359] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] AGENT.logging_expire = 1 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.540513] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.540643] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.540791] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] AGENT.polling_interval = 240 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.540931] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.541089] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] AGENT.quitting_rpc_timeout = 120 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.541235] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] AGENT.report_interval = 30.0 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.541382] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.541528] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.541672] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.541815] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] AGENT.sync_skew = 60 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.541956] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] AGENT.synchronization_queue_size = 20 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.542111] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] AGENT.use_helper_for_ns_read = True {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.542258] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] SECURITYGROUP.enable_ipset = True {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.542405] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] SECURITYGROUP.enable_security_group = True {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.542549] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.542696] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.542846] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] experimental.ipv6_pd_enabled = False {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.543011] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] ml2.extension_drivers = ['port_security'] {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.543151] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] ml2.external_network_type = None {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.543307] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.543480] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] ml2.overlay_ip_version = 4 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.543642] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] ml2.path_mtu = 8950 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.543793] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] ml2.physical_network_mtus = {} {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.543948] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] ml2.tenant_network_types = ['vlan'] {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.544102] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.544256] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] ml2.type_drivers = ['vlan'] {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.544415] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] AGENT_CLI.neutron_port_id = [] {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.544540] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.544683] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.544834] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.545011] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.545140] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.545287] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.545434] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.545603] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.545820] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.545976] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] NSXV3.nsxv3_login_password = **** {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.546143] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] NSXV3.nsxv3_login_port = 443 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.546290] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] NSXV3.nsxv3_login_user = admin {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.546438] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.546628] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.546785] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.546928] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.547090] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.547249] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.547397] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.547545] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.547689] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.547841] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.548053] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.548316] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.548547] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.548794] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.548956] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] vsphere.vsphere_login_password = VMware1! {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.549122] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.549271] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.549442] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] nova.auth_section = None {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.549632] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] nova.auth_type = password {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.549821] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.550011] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] nova.certfile = None {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.550182] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] nova.collect_timing = False {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.550338] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] nova.endpoint_type = public {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.550484] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] nova.insecure = False {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.550624] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] nova.keyfile = None {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.550782] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] nova.region_name = RegionOne {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.550922] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] nova.split_loggers = False {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.551072] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] nova.timeout = None {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.551221] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] placement.auth_section = None {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.551372] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] placement.auth_type = password {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.551520] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.551661] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] placement.certfile = None {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.551805] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] placement.collect_timing = False {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.551953] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] placement.endpoint_type = public {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.552106] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] placement.insecure = False {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.552246] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] placement.keyfile = None {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.552382] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] placement.region_name = None {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.552523] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] placement.split_loggers = False {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.552682] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] placement.timeout = None {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.552857] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] ironic.auth_section = None {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.553028] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] ironic.auth_type = None {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.553160] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] ironic.cafile = None {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.553297] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] ironic.certfile = None {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.553459] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] ironic.collect_timing = False {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.553612] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] ironic.connect_retries = None {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.553754] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] ironic.connect_retry_delay = None {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.553896] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] ironic.enable_notifications = False {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.554043] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] ironic.endpoint_override = None {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.554187] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] ironic.insecure = False {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.554324] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] ironic.interface = None {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.554460] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] ironic.keyfile = None {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.554599] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] ironic.max_version = None {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.554738] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] ironic.min_version = None {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.554875] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] ironic.region_name = None {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.555086] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] ironic.retriable_status_codes = None {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.555164] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] ironic.service_name = None {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.555298] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] ironic.service_type = None {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.555440] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] ironic.split_loggers = False {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.555601] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] ironic.status_code_retries = None {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.555748] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] ironic.status_code_retry_delay = None {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.555887] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] ironic.timeout = None {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.556037] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] ironic.valid_interfaces = None {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.556178] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] ironic.version = None {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.556324] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] cli_script.dry_run = False {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.556477] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.556648] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.556817] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.556993] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.557197] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.557383] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.557571] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.557743] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.558199] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.558199] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.558291] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.558452] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.558626] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.558782] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.558929] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.559095] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.559244] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.559387] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.559540] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.559686] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.559828] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.559972] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.560131] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.560274] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.560414] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.560554] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.560698] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.560838] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.560981] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.561138] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.561284] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] oslo_messaging_rabbit.ssl = False {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.561436] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.561586] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.561731] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.561878] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.562035] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] oslo_messaging_rabbit.ssl_version = {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.562180] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.562333] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] oslo_messaging_notifications.driver = [] {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.562479] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] oslo_messaging_notifications.retry = -1 {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.562640] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.562784] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] oslo_messaging_notifications.transport_url = **** {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 622.562896] env[70392]: DEBUG oslo_service.backend.eventlet.service [None req-71b57bcc-ab12-4b3a-a6d4-0e9a44be465c None None] ******************************************************************************** {{(pid=70392) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 622.564033] env[70392]: DEBUG neutron.agent.securitygroups_rpc [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] Init firewall settings (driver=nsxv3) {{(pid=70392) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 622.565474] env[70392]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=70392) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 622.565740] env[70392]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] RPC agent_id: nsxm-l-01a.corp.local [ 622.568064] env[70392]: DEBUG dogpile.cache.region [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 622.568191] env[70392]: DEBUG dogpile.lock [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 622.568309] env[70392]: DEBUG dogpile.lock [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 622.568387] env[70392]: DEBUG dogpile.lock [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 622.568485] env[70392]: DEBUG dogpile.cache.region [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 622.568579] env[70392]: DEBUG dogpile.lock [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 622.568706] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 622.587939] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] Session token - acquiring [ 622.589719] env[70392]: DEBUG networking_nsxv3.common.locking [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.589939] env[70392]: DEBUG oslo_concurrency.lockutils [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.590017] env[70392]: DEBUG oslo_concurrency.lockutils [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.590481] env[70392]: DEBUG oslo_concurrency.lockutils [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.601569] env[70392]: DEBUG oslo_concurrency.lockutils [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.879429] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 622.907743] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 622.907918] env[70392]: DEBUG dogpile.cache.region [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] Cache value generated in 0.339 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 622.908056] env[70392]: DEBUG dogpile.lock [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 622.908184] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] Activating Policy API Provider. [ 622.908386] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] Looking for the default Infrastructure Rules. [ 622.994566] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] Looking for the Default Layer3 Logged Drop Section. [ 623.013112] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 623.013584] env[70392]: DEBUG networking_nsxv3.common.locking [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.013799] env[70392]: DEBUG oslo_concurrency.lockutils [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] Acquiring lock "all" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.013865] env[70392]: DEBUG oslo_concurrency.lockutils [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] Acquired lock "all" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.014188] env[70392]: DEBUG oslo_concurrency.lockutils [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] Acquired external semaphore "all" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.014525] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.529623] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.032431] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.534367] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] Inventory metadata is going to be refreshed. [ 624.534820] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 625.353624] env[70392]: DEBUG networking_nsxv3.common.locking [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.353887] env[70392]: DEBUG oslo_concurrency.lockutils [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.353929] env[70392]: DEBUG oslo_concurrency.lockutils [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.354252] env[70392]: DEBUG oslo_concurrency.lockutils [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.475750] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 625.476729] env[70392]: DEBUG oslo_concurrency.lockutils [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.477712] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 625.495358] env[70392]: DEBUG networking_nsxv3.common.locking [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.495607] env[70392]: DEBUG oslo_concurrency.lockutils [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.495706] env[70392]: DEBUG oslo_concurrency.lockutils [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.495971] env[70392]: DEBUG oslo_concurrency.lockutils [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.496113] env[70392]: DEBUG oslo_concurrency.lockutils [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.496264] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 625.496383] env[70392]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=70392) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 625.496488] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 625.516463] env[70392]: DEBUG networking_nsxv3.common.locking [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.516708] env[70392]: DEBUG oslo_concurrency.lockutils [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.516775] env[70392]: DEBUG oslo_concurrency.lockutils [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.517036] env[70392]: DEBUG oslo_concurrency.lockutils [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.517215] env[70392]: DEBUG oslo_concurrency.lockutils [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.517374] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 625.537526] env[70392]: DEBUG networking_nsxv3.common.locking [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.537960] env[70392]: DEBUG oslo_concurrency.lockutils [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.537960] env[70392]: DEBUG oslo_concurrency.lockutils [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.538557] env[70392]: DEBUG oslo_concurrency.lockutils [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.538723] env[70392]: DEBUG oslo_concurrency.lockutils [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.538904] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 625.557299] env[70392]: DEBUG networking_nsxv3.common.locking [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.557505] env[70392]: DEBUG oslo_concurrency.lockutils [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] Acquiring lock "Address Group" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.557602] env[70392]: DEBUG oslo_concurrency.lockutils [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] Acquired lock "Address Group" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.557889] env[70392]: DEBUG oslo_concurrency.lockutils [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] Acquired external semaphore "Address Group" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.558046] env[70392]: DEBUG oslo_concurrency.lockutils [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] Releasing lock "Address Group" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.558208] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 625.558317] env[70392]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=70392) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 625.558423] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 625.577271] env[70392]: DEBUG networking_nsxv3.common.locking [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.577525] env[70392]: DEBUG oslo_concurrency.lockutils [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] Acquiring lock "Segment QoS" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.577602] env[70392]: DEBUG oslo_concurrency.lockutils [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] Acquired lock "Segment QoS" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.577852] env[70392]: DEBUG oslo_concurrency.lockutils [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] Acquired external semaphore "Segment QoS" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.578062] env[70392]: DEBUG oslo_concurrency.lockutils [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] Releasing lock "Segment QoS" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.578220] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 625.578329] env[70392]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=70392) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 625.578437] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 625.598772] env[70392]: DEBUG networking_nsxv3.common.locking [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.598974] env[70392]: DEBUG oslo_concurrency.lockutils [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.599048] env[70392]: DEBUG oslo_concurrency.lockutils [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.599347] env[70392]: DEBUG oslo_concurrency.lockutils [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.599491] env[70392]: DEBUG oslo_concurrency.lockutils [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.599642] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 625.599749] env[70392]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=70392) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 625.599852] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] Inventory metadata have been refreshed. [ 625.599951] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] Dryrun:True. Metadata refresh completed. [ 625.600079] env[70392]: DEBUG oslo_concurrency.lockutils [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] Releasing lock "all" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.601793] env[70392]: INFO neutron.agent.agent_extensions_manager [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] Loaded agent extensions: [] [ 625.602486] env[70392]: DEBUG neutron_lib.callbacks.manager [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=70392) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 625.660185] env[70392]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] NSXv3 Agent Agent RPC Daemon Started! [ 625.660308] env[70392]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] NSXv3 Agent Agent loop - iteration:0 started [ 625.660420] env[70392]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] NSXv3 Agent Agent out of sync with plugin! [ 630.603175] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 630.603652] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 631.606279] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.606698] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.606698] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.606866] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.606998] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.109273] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.611689] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.114087] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 633.114380] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 633.911820] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.912236] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.912236] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.912236] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.924086] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 633.924895] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.925530] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 633.943589] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.943824] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.943824] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.944024] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.944119] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.944327] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 633.944327] env[70392]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=70392) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 633.944422] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 633.963057] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.963409] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.963504] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.963717] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.963874] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.963990] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 633.983572] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.983878] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.984011] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.984246] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.984367] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.984492] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 634.011731] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.012032] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.012032] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.012207] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.012318] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.012441] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 634.012518] env[70392]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=70392) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 634.012589] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 634.030675] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.030907] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.030907] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.031082] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.031174] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.031283] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 634.031356] env[70392]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=70392) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 634.031429] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 634.054986] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.055207] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.055207] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.055357] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.055457] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.055578] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 634.055654] env[70392]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=70392) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 634.055794] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 634.055917] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 634.056012] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 634.056083] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 634.056146] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 634.056409] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 634.056473] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 634.056545] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 634.076581] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.076867] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.076867] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.076996] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.077118] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.077227] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 634.099467] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.099704] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.099704] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.099878] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.099985] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.144188] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.604767] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 635.605192] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 639.860227] env[70392]: INFO networking_nsxv3.common.synchronization [None req-1e37a92d-1d7c-40e2-8e75-e9d82ed9f8ff demo admin] Enqueued Resource ID: 84b67b7a-b696-4302-97a3-085c0e6450b7 with Priority: HIGHEST for action security_group_rules [ 639.860738] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84b67b7a-b696-4302-97a3-085c0e6450b7 with Priority: HIGHEST for action security_group_rules [ 639.861303] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-84b67b7a-b696-4302-97a3-085c0e6450b7 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.861437] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-84b67b7a-b696-4302-97a3-085c0e6450b7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.861508] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-84b67b7a-b696-4302-97a3-085c0e6450b7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.861773] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-84b67b7a-b696-4302-97a3-085c0e6450b7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.861841] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('84b67b7a-b696-4302-97a3-085c0e6450b7',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.385993] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.385993] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.385993] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.385993] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.385993] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.385993] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 84b67b7a-b696-4302-97a3-085c0e6450b7 already deleted. [ 640.385993] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-84b67b7a-b696-4302-97a3-085c0e6450b7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.862583] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 644.862583] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 649.863609] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 649.863609] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 654.864911] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 654.865333] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 659.865909] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 659.866301] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 664.867233] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 664.867578] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 665.068048] env[70392]: INFO networking_nsxv3.common.synchronization [None req-c2a79d01-8873-43ca-8671-d4ec9606a173 None None] Enqueued Resource ID: f30ae3a3-6a30-41f9-a1c0-919a6d945bf5 with Priority: HIGHEST for action port [ 665.068048] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f30ae3a3-6a30-41f9-a1c0-919a6d945bf5 with Priority: HIGHEST for action port [ 665.068048] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-f30ae3a3-6a30-41f9-a1c0-919a6d945bf5 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.068048] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f30ae3a3-6a30-41f9-a1c0-919a6d945bf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.068048] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f30ae3a3-6a30-41f9-a1c0-919a6d945bf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.068048] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f30ae3a3-6a30-41f9-a1c0-919a6d945bf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.068587] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f30ae3a3-6a30-41f9-a1c0-919a6d945bf5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.573088] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f30ae3a3-6a30-41f9-a1c0-919a6d945bf5 [ 665.573088] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.573088] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.573088] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.573088] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.573088] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.573088] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f30ae3a3-6a30-41f9-a1c0-919a6d945bf5 already deleted. [ 665.573088] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f30ae3a3-6a30-41f9-a1c0-919a6d945bf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.942250] env[70392]: INFO networking_nsxv3.common.synchronization [None req-2c2b0efe-723a-48d4-977a-5f4b952b1043 None None] Enqueued Resource ID: 7a27cec7-28fc-433a-bfbc-2a89015898e5 with Priority: HIGHEST for action port [ 666.942953] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a27cec7-28fc-433a-bfbc-2a89015898e5 with Priority: HIGHEST for action port [ 666.943534] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-7a27cec7-28fc-433a-bfbc-2a89015898e5 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.943756] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7a27cec7-28fc-433a-bfbc-2a89015898e5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.943878] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7a27cec7-28fc-433a-bfbc-2a89015898e5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.944146] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7a27cec7-28fc-433a-bfbc-2a89015898e5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.944239] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a27cec7-28fc-433a-bfbc-2a89015898e5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.446775] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7a27cec7-28fc-433a-bfbc-2a89015898e5 [ 667.447078] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.447273] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.447381] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.447638] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.447762] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.447926] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7a27cec7-28fc-433a-bfbc-2a89015898e5 already deleted. [ 667.448052] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7a27cec7-28fc-433a-bfbc-2a89015898e5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.656376] env[70392]: INFO networking_nsxv3.common.synchronization [None req-f08fd1a6-5c8a-454d-bb2a-5583b7ac1003 None None] Enqueued Resource ID: 60a671db-1ef5-47e4-956a-5e95bcf9b7c8 with Priority: HIGHEST for action port [ 671.657692] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60a671db-1ef5-47e4-956a-5e95bcf9b7c8 with Priority: HIGHEST for action port [ 671.657692] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-60a671db-1ef5-47e4-956a-5e95bcf9b7c8 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.657692] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-60a671db-1ef5-47e4-956a-5e95bcf9b7c8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.657692] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-60a671db-1ef5-47e4-956a-5e95bcf9b7c8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.657958] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-60a671db-1ef5-47e4-956a-5e95bcf9b7c8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.658033] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60a671db-1ef5-47e4-956a-5e95bcf9b7c8',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.160708] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 60a671db-1ef5-47e4-956a-5e95bcf9b7c8 [ 672.161477] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.161997] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.163327] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.163327] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.163327] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.163327] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:60a671db-1ef5-47e4-956a-5e95bcf9b7c8 already deleted. [ 672.163327] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-60a671db-1ef5-47e4-956a-5e95bcf9b7c8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.871697] env[70392]: INFO networking_nsxv3.common.synchronization [None req-1592dae3-9367-4859-a8d8-1bdfe486b577 None None] Enqueued Resource ID: 1601f4dd-fd34-4f8b-9865-6322212bb49d with Priority: HIGHEST for action port [ 672.872106] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1601f4dd-fd34-4f8b-9865-6322212bb49d with Priority: HIGHEST for action port [ 672.872990] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-1601f4dd-fd34-4f8b-9865-6322212bb49d taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.873277] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1601f4dd-fd34-4f8b-9865-6322212bb49d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.873360] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1601f4dd-fd34-4f8b-9865-6322212bb49d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.873798] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1601f4dd-fd34-4f8b-9865-6322212bb49d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.873865] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1601f4dd-fd34-4f8b-9865-6322212bb49d',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.891390] env[70392]: INFO networking_nsxv3.common.synchronization [None req-368056cd-dcd4-4637-9997-33e30b6b801d None None] Enqueued Resource ID: 64b0fcf8-a7b4-4fdb-9e27-339ffd0fda3d with Priority: HIGHEST for action port [ 672.892908] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64b0fcf8-a7b4-4fdb-9e27-339ffd0fda3d with Priority: HIGHEST for action port [ 672.893369] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-64b0fcf8-a7b4-4fdb-9e27-339ffd0fda3d taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.893369] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-64b0fcf8-a7b4-4fdb-9e27-339ffd0fda3d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.893630] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-64b0fcf8-a7b4-4fdb-9e27-339ffd0fda3d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.893745] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-64b0fcf8-a7b4-4fdb-9e27-339ffd0fda3d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.894885] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64b0fcf8-a7b4-4fdb-9e27-339ffd0fda3d',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.377888] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1601f4dd-fd34-4f8b-9865-6322212bb49d [ 673.377888] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.377888] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.377888] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.377888] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.377888] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.377888] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1601f4dd-fd34-4f8b-9865-6322212bb49d already deleted. [ 673.377888] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1601f4dd-fd34-4f8b-9865-6322212bb49d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.397698] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 64b0fcf8-a7b4-4fdb-9e27-339ffd0fda3d [ 673.398025] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.398547] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.398626] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.398845] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.398938] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.399056] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:64b0fcf8-a7b4-4fdb-9e27-339ffd0fda3d already deleted. [ 673.399336] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-64b0fcf8-a7b4-4fdb-9e27-339ffd0fda3d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.417573] env[70392]: INFO networking_nsxv3.common.synchronization [None req-6532825b-79d8-47b8-8129-2674ca06b8f0 None None] Enqueued Resource ID: b5a1c1c6-f499-4fe3-9ba1-c282fb84557f with Priority: HIGHEST for action port [ 673.417573] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5a1c1c6-f499-4fe3-9ba1-c282fb84557f with Priority: HIGHEST for action port [ 673.417573] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-b5a1c1c6-f499-4fe3-9ba1-c282fb84557f taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.417573] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b5a1c1c6-f499-4fe3-9ba1-c282fb84557f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.417573] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b5a1c1c6-f499-4fe3-9ba1-c282fb84557f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.417573] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b5a1c1c6-f499-4fe3-9ba1-c282fb84557f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.417573] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5a1c1c6-f499-4fe3-9ba1-c282fb84557f',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.679145] env[70392]: INFO networking_nsxv3.common.synchronization [None req-1a971624-94a6-4dac-a65a-5b3d71fce5b6 None None] Enqueued Resource ID: 40cb72a2-b4eb-483e-98b6-a05f8d379932 with Priority: HIGHEST for action port [ 673.680506] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40cb72a2-b4eb-483e-98b6-a05f8d379932 with Priority: HIGHEST for action port [ 673.680506] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-40cb72a2-b4eb-483e-98b6-a05f8d379932 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.680506] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-40cb72a2-b4eb-483e-98b6-a05f8d379932" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.680506] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-40cb72a2-b4eb-483e-98b6-a05f8d379932" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.680506] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-40cb72a2-b4eb-483e-98b6-a05f8d379932" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.680506] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40cb72a2-b4eb-483e-98b6-a05f8d379932',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.920317] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b5a1c1c6-f499-4fe3-9ba1-c282fb84557f [ 673.920593] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.920593] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.920682] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.920867] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.920951] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.921084] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b5a1c1c6-f499-4fe3-9ba1-c282fb84557f already deleted. [ 673.921240] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b5a1c1c6-f499-4fe3-9ba1-c282fb84557f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.185786] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 40cb72a2-b4eb-483e-98b6-a05f8d379932 [ 674.186039] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.186222] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.186271] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.186996] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.186996] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.186996] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:40cb72a2-b4eb-483e-98b6-a05f8d379932 already deleted. [ 674.186996] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-40cb72a2-b4eb-483e-98b6-a05f8d379932" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.326114] env[70392]: INFO networking_nsxv3.common.synchronization [None req-078bb88b-8ac9-49b5-96da-10017b697c28 None None] Enqueued Resource ID: 3ce0e1cb-c3cb-401c-9352-f61e975e4f82 with Priority: HIGHEST for action port [ 674.326114] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ce0e1cb-c3cb-401c-9352-f61e975e4f82 with Priority: HIGHEST for action port [ 674.326114] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-3ce0e1cb-c3cb-401c-9352-f61e975e4f82 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.326114] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3ce0e1cb-c3cb-401c-9352-f61e975e4f82" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.326114] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3ce0e1cb-c3cb-401c-9352-f61e975e4f82" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.326114] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3ce0e1cb-c3cb-401c-9352-f61e975e4f82" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.326114] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ce0e1cb-c3cb-401c-9352-f61e975e4f82',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.829086] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3ce0e1cb-c3cb-401c-9352-f61e975e4f82 [ 674.829337] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.829480] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.829555] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.829783] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.829879] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.830263] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3ce0e1cb-c3cb-401c-9352-f61e975e4f82 already deleted. [ 674.830394] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3ce0e1cb-c3cb-401c-9352-f61e975e4f82" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.972530] env[70392]: INFO networking_nsxv3.common.synchronization [None req-867a2189-a1e7-4ee0-988a-176048d51053 None None] Enqueued Resource ID: f22342dc-010b-4a12-8373-382c191fc49d with Priority: HIGHEST for action port [ 675.972836] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f22342dc-010b-4a12-8373-382c191fc49d with Priority: HIGHEST for action port [ 675.973897] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-f22342dc-010b-4a12-8373-382c191fc49d taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.973897] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f22342dc-010b-4a12-8373-382c191fc49d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.973897] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f22342dc-010b-4a12-8373-382c191fc49d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.973897] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f22342dc-010b-4a12-8373-382c191fc49d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.974234] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f22342dc-010b-4a12-8373-382c191fc49d',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.479023] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f22342dc-010b-4a12-8373-382c191fc49d [ 676.479023] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.479023] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.479023] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.479504] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.479628] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.479730] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f22342dc-010b-4a12-8373-382c191fc49d already deleted. [ 676.479813] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f22342dc-010b-4a12-8373-382c191fc49d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.733239] env[70392]: INFO networking_nsxv3.common.synchronization [None req-7a85b858-d44c-4aec-bce7-879cc40a4add None None] Enqueued Resource ID: 86b0f956-32d0-4e96-8651-16fe0d46a162 with Priority: HIGHEST for action port [ 676.733239] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86b0f956-32d0-4e96-8651-16fe0d46a162 with Priority: HIGHEST for action port [ 676.733239] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-86b0f956-32d0-4e96-8651-16fe0d46a162 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.733239] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-86b0f956-32d0-4e96-8651-16fe0d46a162" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.733239] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-86b0f956-32d0-4e96-8651-16fe0d46a162" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.733239] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-86b0f956-32d0-4e96-8651-16fe0d46a162" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.733239] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86b0f956-32d0-4e96-8651-16fe0d46a162',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.904586] env[70392]: INFO networking_nsxv3.common.synchronization [None req-43974a57-892e-4174-a268-3b4d9d2d2f08 None None] Enqueued Resource ID: f927e5d0-cbf7-4df3-89f8-338010da061c with Priority: HIGHEST for action port [ 676.904787] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f927e5d0-cbf7-4df3-89f8-338010da061c with Priority: HIGHEST for action port [ 676.905326] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-f927e5d0-cbf7-4df3-89f8-338010da061c taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.905450] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f927e5d0-cbf7-4df3-89f8-338010da061c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.906327] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f927e5d0-cbf7-4df3-89f8-338010da061c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.906327] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f927e5d0-cbf7-4df3-89f8-338010da061c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.906327] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f927e5d0-cbf7-4df3-89f8-338010da061c',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.235564] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 86b0f956-32d0-4e96-8651-16fe0d46a162 [ 677.235899] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.235960] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.236091] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.236503] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.236503] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.236503] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:86b0f956-32d0-4e96-8651-16fe0d46a162 already deleted. [ 677.236772] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-86b0f956-32d0-4e96-8651-16fe0d46a162" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.282145] env[70392]: INFO networking_nsxv3.common.synchronization [None req-04a001bc-b3c7-488f-a6fc-205423321608 None None] Enqueued Resource ID: df970e41-02d4-4ce7-89fd-2627f9373b51 with Priority: HIGHEST for action port [ 677.282433] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df970e41-02d4-4ce7-89fd-2627f9373b51 with Priority: HIGHEST for action port [ 677.282970] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-df970e41-02d4-4ce7-89fd-2627f9373b51 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.283133] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df970e41-02d4-4ce7-89fd-2627f9373b51" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.283188] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df970e41-02d4-4ce7-89fd-2627f9373b51" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.283400] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df970e41-02d4-4ce7-89fd-2627f9373b51" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.283477] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df970e41-02d4-4ce7-89fd-2627f9373b51',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.409552] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f927e5d0-cbf7-4df3-89f8-338010da061c [ 677.409823] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.409970] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.410042] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.410258] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.410350] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.410448] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f927e5d0-cbf7-4df3-89f8-338010da061c already deleted. [ 677.410530] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f927e5d0-cbf7-4df3-89f8-338010da061c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.787057] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port df970e41-02d4-4ce7-89fd-2627f9373b51 [ 677.787303] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.787438] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.787505] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.791021] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.791021] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.791021] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:df970e41-02d4-4ce7-89fd-2627f9373b51 already deleted. [ 677.791021] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df970e41-02d4-4ce7-89fd-2627f9373b51" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.327842] env[70392]: INFO networking_nsxv3.common.synchronization [None req-46bc7fd3-6ff2-4d0c-a7e1-a8aba5057a97 None None] Enqueued Resource ID: 5480af13-a72b-4e5d-91ee-9b89a77709c6 with Priority: HIGHEST for action port [ 678.328231] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5480af13-a72b-4e5d-91ee-9b89a77709c6 with Priority: HIGHEST for action port [ 678.328566] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-5480af13-a72b-4e5d-91ee-9b89a77709c6 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.328709] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5480af13-a72b-4e5d-91ee-9b89a77709c6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.328925] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5480af13-a72b-4e5d-91ee-9b89a77709c6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.329799] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5480af13-a72b-4e5d-91ee-9b89a77709c6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.329799] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5480af13-a72b-4e5d-91ee-9b89a77709c6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.755274] env[70392]: INFO networking_nsxv3.common.synchronization [None req-a860291a-d727-4c4d-a201-8c9fc2b92f25 None None] Enqueued Resource ID: 3f4448ab-7adb-4799-bbb8-341f5d9e567c with Priority: HIGHEST for action port [ 678.755274] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f4448ab-7adb-4799-bbb8-341f5d9e567c with Priority: HIGHEST for action port [ 678.755700] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-3f4448ab-7adb-4799-bbb8-341f5d9e567c taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.757919] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3f4448ab-7adb-4799-bbb8-341f5d9e567c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.757919] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3f4448ab-7adb-4799-bbb8-341f5d9e567c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.757919] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3f4448ab-7adb-4799-bbb8-341f5d9e567c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.757919] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3f4448ab-7adb-4799-bbb8-341f5d9e567c',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.830668] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5480af13-a72b-4e5d-91ee-9b89a77709c6 [ 678.830893] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.831806] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.831890] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.832589] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.832589] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.832589] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5480af13-a72b-4e5d-91ee-9b89a77709c6 already deleted. [ 678.832589] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5480af13-a72b-4e5d-91ee-9b89a77709c6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.263018] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3f4448ab-7adb-4799-bbb8-341f5d9e567c [ 679.263261] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.263395] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.263914] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.263914] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.263914] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.263914] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3f4448ab-7adb-4799-bbb8-341f5d9e567c already deleted. [ 679.263914] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3f4448ab-7adb-4799-bbb8-341f5d9e567c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.044204] env[70392]: INFO networking_nsxv3.common.synchronization [None req-88e8e6af-1af7-4043-8e82-bf21b4d40456 None None] Enqueued Resource ID: e98f2174-d997-4340-8bf3-72667db90998 with Priority: HIGHEST for action port [ 680.045035] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e98f2174-d997-4340-8bf3-72667db90998 with Priority: HIGHEST for action port [ 680.046446] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-e98f2174-d997-4340-8bf3-72667db90998 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.046446] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e98f2174-d997-4340-8bf3-72667db90998" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.046446] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e98f2174-d997-4340-8bf3-72667db90998" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.046870] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e98f2174-d997-4340-8bf3-72667db90998" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.047037] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e98f2174-d997-4340-8bf3-72667db90998',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.550249] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e98f2174-d997-4340-8bf3-72667db90998 [ 680.550541] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.550695] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.550768] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.550983] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.551087] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.551183] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e98f2174-d997-4340-8bf3-72667db90998 already deleted. [ 680.551261] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e98f2174-d997-4340-8bf3-72667db90998" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.952172] env[70392]: INFO networking_nsxv3.common.synchronization [req-ac4e7e34-424e-4ed0-a354-195ba3dc1c10 req-d455ca27-0322-4981-a83f-c353c3c4718c tempest-ServersAdminNegativeTestJSON-1845401423 tempest-ServersAdminNegativeTestJSON-1845401423-project-member] Enqueued Resource ID: 59adf132-72f4-4d43-847e-1af9bc3c6073 with Priority: HIGHEST for action security_group_members [ 680.952172] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59adf132-72f4-4d43-847e-1af9bc3c6073 with Priority: HIGHEST for action security_group_members [ 680.952172] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-59adf132-72f4-4d43-847e-1af9bc3c6073 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.952172] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59adf132-72f4-4d43-847e-1af9bc3c6073" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.952172] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59adf132-72f4-4d43-847e-1af9bc3c6073" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.952172] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59adf132-72f4-4d43-847e-1af9bc3c6073" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.952413] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.952413] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.952413] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.953214] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.953214] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.953214] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('59adf132-72f4-4d43-847e-1af9bc3c6073',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.456708] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.457060] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.457060] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.457231] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.457559] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.458827] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.458827] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.458827] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.458827] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.458827] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.458827] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59adf132-72f4-4d43-847e-1af9bc3c6073 already deleted. [ 681.458827] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59adf132-72f4-4d43-847e-1af9bc3c6073" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.172863] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-325 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.173076] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-325" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.173205] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-325" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.173554] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-325" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.176325] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.176325] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.176325] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.176325] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.176325] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.176325] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 682.176325] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 682.176325] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 682.176325] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 682.176325] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 682.176793] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 682.176793] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 682.185094] env[70392]: INFO networking_nsxv3.common.synchronization [None req-d7067918-5515-4397-a68e-63479984576b None None] Enqueued Resource ID: 02d5c527-464a-4eec-bffe-06d177be2a01 with Priority: HIGHEST for action port [ 682.185591] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02d5c527-464a-4eec-bffe-06d177be2a01 with Priority: HIGHEST for action port [ 682.187182] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-02d5c527-464a-4eec-bffe-06d177be2a01 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.187507] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-02d5c527-464a-4eec-bffe-06d177be2a01" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.187591] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-02d5c527-464a-4eec-bffe-06d177be2a01" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.187863] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-02d5c527-464a-4eec-bffe-06d177be2a01" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.187962] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02d5c527-464a-4eec-bffe-06d177be2a01',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.199018] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 682.199018] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 682.199179] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 682.201446] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-325" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.201446] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-d44ce972-2b4a-4daa-ad43-c51a6337d948 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.201446] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-d44ce972-2b4a-4daa-ad43-c51a6337d948" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.201446] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-d44ce972-2b4a-4daa-ad43-c51a6337d948" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.201446] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-d44ce972-2b4a-4daa-ad43-c51a6337d948" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.201446] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d44ce972-2b4a-4daa-ad43-c51a6337d948',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.690739] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 02d5c527-464a-4eec-bffe-06d177be2a01 [ 682.691626] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.691865] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.692137] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.692737] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.693044] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.693297] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:02d5c527-464a-4eec-bffe-06d177be2a01 already deleted. [ 682.693433] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-02d5c527-464a-4eec-bffe-06d177be2a01" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.704837] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.704837] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.704837] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.704837] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.704837] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.705135] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port d44ce972-2b4a-4daa-ad43-c51a6337d948 not found, creating... [ 682.707574] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.707574] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.707574] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.707574] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.707574] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.707574] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.707574] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.707574] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.707574] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.707574] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.708033] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: d44ce972-2b4a-4daa-ad43-c51a6337d948 is going to be created. [ 682.752276] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.756419] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.756556] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.756896] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.757702] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.757702] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-d44ce972-2b4a-4daa-ad43-c51a6337d948" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.789272] env[70392]: INFO networking_nsxv3.common.synchronization [None req-58948b4c-772e-467a-9de0-84077164702b None None] Enqueued Resource ID: 3f0036ec-fa2f-45d4-a3f2-175e8788b664 with Priority: HIGHEST for action port [ 682.789910] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f0036ec-fa2f-45d4-a3f2-175e8788b664 with Priority: HIGHEST for action port [ 682.790109] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-3f0036ec-fa2f-45d4-a3f2-175e8788b664 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.790233] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3f0036ec-fa2f-45d4-a3f2-175e8788b664" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.790297] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3f0036ec-fa2f-45d4-a3f2-175e8788b664" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.790539] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3f0036ec-fa2f-45d4-a3f2-175e8788b664" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.790615] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3f0036ec-fa2f-45d4-a3f2-175e8788b664',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.252172] env[70392]: INFO networking_nsxv3.common.synchronization [None req-3996d095-0b4c-409c-b0f9-a8f0f4184755 None None] Enqueued Resource ID: 5c17490e-e287-4cdb-b30f-827fcf1f95bf with Priority: HIGHEST for action port [ 683.252172] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c17490e-e287-4cdb-b30f-827fcf1f95bf with Priority: HIGHEST for action port [ 683.252172] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-5c17490e-e287-4cdb-b30f-827fcf1f95bf taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.252172] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5c17490e-e287-4cdb-b30f-827fcf1f95bf" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.252172] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5c17490e-e287-4cdb-b30f-827fcf1f95bf" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.252172] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5c17490e-e287-4cdb-b30f-827fcf1f95bf" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.252172] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c17490e-e287-4cdb-b30f-827fcf1f95bf',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.293976] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3f0036ec-fa2f-45d4-a3f2-175e8788b664 [ 683.294204] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.294312] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.294455] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.294770] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.294911] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.295085] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3f0036ec-fa2f-45d4-a3f2-175e8788b664 already deleted. [ 683.295233] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3f0036ec-fa2f-45d4-a3f2-175e8788b664" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.311089] env[70392]: INFO networking_nsxv3.common.synchronization [req-2ea11e3c-e521-4a57-837e-b11ca489c840 req-1470208c-47f0-42cd-9fbf-b00e877553d5 tempest-DeleteServersAdminTestJSON-896255795 tempest-DeleteServersAdminTestJSON-896255795-project-member] Enqueued Resource ID: f0999f45-c89f-488f-b038-36a93b2cdeb4 with Priority: HIGHEST for action security_group_members [ 683.311618] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0999f45-c89f-488f-b038-36a93b2cdeb4 with Priority: HIGHEST for action security_group_members [ 683.312040] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0999f45-c89f-488f-b038-36a93b2cdeb4 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.312207] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0999f45-c89f-488f-b038-36a93b2cdeb4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.312252] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0999f45-c89f-488f-b038-36a93b2cdeb4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.312533] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0999f45-c89f-488f-b038-36a93b2cdeb4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.312654] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.312767] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.312823] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.313017] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.313067] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.313199] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0999f45-c89f-488f-b038-36a93b2cdeb4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.761321] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5c17490e-e287-4cdb-b30f-827fcf1f95bf [ 683.761321] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.761321] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.761321] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.761321] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.761321] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.761321] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5c17490e-e287-4cdb-b30f-827fcf1f95bf already deleted. [ 683.761321] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5c17490e-e287-4cdb-b30f-827fcf1f95bf" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.815615] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.815615] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.815810] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.815890] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.815988] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.816338] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.816338] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.816338] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.816600] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.816600] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.816668] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0999f45-c89f-488f-b038-36a93b2cdeb4 already deleted. [ 683.816740] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0999f45-c89f-488f-b038-36a93b2cdeb4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.869723] env[70392]: INFO networking_nsxv3.common.synchronization [req-ac4e7e34-424e-4ed0-a354-195ba3dc1c10 req-4c706b5c-0c4f-40e7-aa7d-577039ca501c service nova] Enqueued Resource ID: 59adf132-72f4-4d43-847e-1af9bc3c6073 with Priority: HIGHEST for action security_group_rules [ 683.870013] env[70392]: INFO networking_nsxv3.common.synchronization [req-ac4e7e34-424e-4ed0-a354-195ba3dc1c10 req-4c706b5c-0c4f-40e7-aa7d-577039ca501c service nova] Enqueued Resource ID: 59adf132-72f4-4d43-847e-1af9bc3c6073 with Priority: HIGHEST for action security_group_members [ 683.870076] env[70392]: INFO networking_nsxv3.common.synchronization [req-ac4e7e34-424e-4ed0-a354-195ba3dc1c10 req-4c706b5c-0c4f-40e7-aa7d-577039ca501c service nova] Enqueued Resource ID: d44ce972-2b4a-4daa-ad43-c51a6337d948 with Priority: HIGHEST for action port [ 683.870331] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59adf132-72f4-4d43-847e-1af9bc3c6073 with Priority: HIGHEST for action security_group_rules [ 683.870459] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59adf132-72f4-4d43-847e-1af9bc3c6073 with Priority: HIGHEST for action security_group_members [ 683.870550] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d44ce972-2b4a-4daa-ad43-c51a6337d948 with Priority: HIGHEST for action port [ 683.872896] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-59adf132-72f4-4d43-847e-1af9bc3c6073 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.872896] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-59adf132-72f4-4d43-847e-1af9bc3c6073" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.872896] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-59adf132-72f4-4d43-847e-1af9bc3c6073" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.872896] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-59adf132-72f4-4d43-847e-1af9bc3c6073" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.872896] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('59adf132-72f4-4d43-847e-1af9bc3c6073',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.878102] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-59adf132-72f4-4d43-847e-1af9bc3c6073 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.878102] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59adf132-72f4-4d43-847e-1af9bc3c6073" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.878102] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59adf132-72f4-4d43-847e-1af9bc3c6073" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.878102] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59adf132-72f4-4d43-847e-1af9bc3c6073" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.878102] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.878102] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.878102] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.878102] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.878102] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.878102] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('59adf132-72f4-4d43-847e-1af9bc3c6073',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.878102] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-d44ce972-2b4a-4daa-ad43-c51a6337d948 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.878102] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d44ce972-2b4a-4daa-ad43-c51a6337d948" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.878102] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d44ce972-2b4a-4daa-ad43-c51a6337d948" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.878102] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d44ce972-2b4a-4daa-ad43-c51a6337d948" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.879537] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d44ce972-2b4a-4daa-ad43-c51a6337d948',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.125202] env[70392]: INFO networking_nsxv3.common.synchronization [None req-66a7d5d3-302f-4b24-abc2-4565c41eeecd None None] Enqueued Resource ID: 400d0675-2ae3-417b-b685-e5beac3a0cec with Priority: HIGHEST for action port [ 684.125202] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 400d0675-2ae3-417b-b685-e5beac3a0cec with Priority: HIGHEST for action port [ 684.125202] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-400d0675-2ae3-417b-b685-e5beac3a0cec taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.125202] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-400d0675-2ae3-417b-b685-e5beac3a0cec" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.125202] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-400d0675-2ae3-417b-b685-e5beac3a0cec" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.125202] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-400d0675-2ae3-417b-b685-e5beac3a0cec" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.125202] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('400d0675-2ae3-417b-b685-e5beac3a0cec',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.382598] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-59adf132-72f4-4d43-847e-1af9bc3c6073 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.382738] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59adf132-72f4-4d43-847e-1af9bc3c6073" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.398023] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d44ce972-2b4a-4daa-ad43-c51a6337d948 with status ACTIVE [ 684.398023] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.398023] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.398023] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.398023] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.398023] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.398023] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.398023] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.398023] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.398023] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.398023] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.398023] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.398023] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.398023] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.398023] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.398023] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.398023] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d44ce972-2b4a-4daa-ad43-c51a6337d948 is going to be updated. [ 684.399061] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('59adf132-72f4-4d43-847e-1af9bc3c6073',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.427228] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.427228] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.427228] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.427228] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.427228] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.427228] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d44ce972-2b4a-4daa-ad43-c51a6337d948" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.555542] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-325 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.555542] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-325" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.555542] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-325" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.556232] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-325" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.556738] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.557139] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.557685] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.558125] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.558438] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.558949] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 684.559770] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 684.559770] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 684.559770] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 684.559770] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 684.559958] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 684.562230] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 684.567062] env[70392]: INFO networking_nsxv3.common.synchronization [None req-a6d95a8e-c968-457a-9b4f-9f17eaafc19d None None] Enqueued Resource ID: 718c6920-ad2c-4892-b780-51b6cf63af4d with Priority: HIGHEST for action port [ 684.568748] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 718c6920-ad2c-4892-b780-51b6cf63af4d with Priority: HIGHEST for action port [ 684.568748] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-718c6920-ad2c-4892-b780-51b6cf63af4d taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.568748] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-718c6920-ad2c-4892-b780-51b6cf63af4d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.568748] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-718c6920-ad2c-4892-b780-51b6cf63af4d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.568748] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-718c6920-ad2c-4892-b780-51b6cf63af4d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.568748] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('718c6920-ad2c-4892-b780-51b6cf63af4d',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.581367] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 684.581367] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 684.581528] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 684.581601] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-325" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.581928] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-92e5af87-99c2-4c75-ab2f-1f642091d8cb taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.582128] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-92e5af87-99c2-4c75-ab2f-1f642091d8cb" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.582374] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-92e5af87-99c2-4c75-ab2f-1f642091d8cb" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.583143] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-92e5af87-99c2-4c75-ab2f-1f642091d8cb" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.583832] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92e5af87-99c2-4c75-ab2f-1f642091d8cb',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.632922] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 400d0675-2ae3-417b-b685-e5beac3a0cec [ 684.632922] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.634295] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.634295] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.634295] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.634295] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.634295] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:400d0675-2ae3-417b-b685-e5beac3a0cec already deleted. [ 684.634295] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-400d0675-2ae3-417b-b685-e5beac3a0cec" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.902316] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('59adf132-72f4-4d43-847e-1af9bc3c6073',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.071785] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 718c6920-ad2c-4892-b780-51b6cf63af4d [ 685.072463] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.072463] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.072463] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.072726] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.072726] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.072820] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:718c6920-ad2c-4892-b780-51b6cf63af4d already deleted. [ 685.072908] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-718c6920-ad2c-4892-b780-51b6cf63af4d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.091206] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.091668] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.092145] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.092239] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.092433] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.092562] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 92e5af87-99c2-4c75-ab2f-1f642091d8cb not found, creating... [ 685.092822] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.093199] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.093199] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.093318] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.093452] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.093846] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.093936] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.094341] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.094341] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.094483] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.094581] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 92e5af87-99c2-4c75-ab2f-1f642091d8cb is going to be created. [ 685.117691] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.117691] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.117691] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.117691] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.117691] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.117691] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-92e5af87-99c2-4c75-ab2f-1f642091d8cb" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.406601] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.406601] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.406601] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.406601] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.406601] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.406601] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59adf132-72f4-4d43-847e-1af9bc3c6073 is going to be created. [ 685.504481] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.504481] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.504481] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.504481] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.504481] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.520263] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59adf132-72f4-4d43-847e-1af9bc3c6073 in Status: UNINITIALIZED for 2s [ 685.568366] env[70392]: INFO networking_nsxv3.common.synchronization [req-d4f47b38-3c2b-4247-abc4-e94ed4176210 req-be227b18-6f8a-48c2-8a4e-960c4488e0b6 tempest-ServerDiskConfigTestJSON-277542510 tempest-ServerDiskConfigTestJSON-277542510-project-member] Enqueued Resource ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 with Priority: HIGHEST for action security_group_members [ 685.568788] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 with Priority: HIGHEST for action security_group_members [ 685.569119] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60d7eaa-9583-4c75-97fa-4049c63576b6 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.569244] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.569311] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.569561] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.569717] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.569813] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.569877] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.570561] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.570561] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.570561] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b60d7eaa-9583-4c75-97fa-4049c63576b6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.075509] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.075770] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.075770] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.077210] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.077210] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.077210] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.077210] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.077210] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.077210] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.077210] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.077210] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 already deleted. [ 686.077210] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.224919] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-256 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.224919] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-256" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.225161] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-256" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.225404] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-256" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.228197] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.228197] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.228197] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.228197] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.228197] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.228197] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 686.228197] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 686.228197] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 686.228589] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 686.228589] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 686.228589] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 686.228589] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 686.254121] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 686.254879] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 686.254879] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 686.254879] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-256" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.255089] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-a0ba1014-e43f-4e2f-a2fe-6a5acba27aca taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.255201] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-a0ba1014-e43f-4e2f-a2fe-6a5acba27aca" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.255647] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-a0ba1014-e43f-4e2f-a2fe-6a5acba27aca" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.255647] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-a0ba1014-e43f-4e2f-a2fe-6a5acba27aca" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.255801] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a0ba1014-e43f-4e2f-a2fe-6a5acba27aca',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.663019] env[70392]: INFO networking_nsxv3.common.synchronization [req-2ea11e3c-e521-4a57-837e-b11ca489c840 req-38f6d27f-c8d6-44de-99e4-96154792bb69 service nova] Enqueued Resource ID: f0999f45-c89f-488f-b038-36a93b2cdeb4 with Priority: HIGHEST for action security_group_rules [ 686.663019] env[70392]: INFO networking_nsxv3.common.synchronization [req-2ea11e3c-e521-4a57-837e-b11ca489c840 req-38f6d27f-c8d6-44de-99e4-96154792bb69 service nova] Enqueued Resource ID: f0999f45-c89f-488f-b038-36a93b2cdeb4 with Priority: HIGHEST for action security_group_members [ 686.663019] env[70392]: INFO networking_nsxv3.common.synchronization [req-2ea11e3c-e521-4a57-837e-b11ca489c840 req-38f6d27f-c8d6-44de-99e4-96154792bb69 service nova] Enqueued Resource ID: 92e5af87-99c2-4c75-ab2f-1f642091d8cb with Priority: HIGHEST for action port [ 686.663019] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0999f45-c89f-488f-b038-36a93b2cdeb4 with Priority: HIGHEST for action security_group_rules [ 686.663019] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0999f45-c89f-488f-b038-36a93b2cdeb4 with Priority: HIGHEST for action security_group_members [ 686.663019] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92e5af87-99c2-4c75-ab2f-1f642091d8cb with Priority: HIGHEST for action port [ 686.663019] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f0999f45-c89f-488f-b038-36a93b2cdeb4 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.663019] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f0999f45-c89f-488f-b038-36a93b2cdeb4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.663019] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f0999f45-c89f-488f-b038-36a93b2cdeb4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.663019] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f0999f45-c89f-488f-b038-36a93b2cdeb4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.663019] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f0999f45-c89f-488f-b038-36a93b2cdeb4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.664501] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0999f45-c89f-488f-b038-36a93b2cdeb4 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.664750] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0999f45-c89f-488f-b038-36a93b2cdeb4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.664897] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0999f45-c89f-488f-b038-36a93b2cdeb4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.665166] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0999f45-c89f-488f-b038-36a93b2cdeb4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.665426] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.665629] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.665773] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.665998] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.666194] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.666357] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0999f45-c89f-488f-b038-36a93b2cdeb4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.667432] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-92e5af87-99c2-4c75-ab2f-1f642091d8cb taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.667754] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-92e5af87-99c2-4c75-ab2f-1f642091d8cb" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.667920] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-92e5af87-99c2-4c75-ab2f-1f642091d8cb" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.669425] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-92e5af87-99c2-4c75-ab2f-1f642091d8cb" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.669425] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92e5af87-99c2-4c75-ab2f-1f642091d8cb',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.763403] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.763633] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.763764] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.764063] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.764222] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.764448] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port a0ba1014-e43f-4e2f-a2fe-6a5acba27aca not found, creating... [ 686.764691] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.764890] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.765016] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.765248] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.765384] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.765671] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.765827] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.765971] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.768657] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.768657] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.772021] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: a0ba1014-e43f-4e2f-a2fe-6a5acba27aca is going to be created. [ 686.792268] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.792491] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.792613] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.792905] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.793151] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.793634] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-a0ba1014-e43f-4e2f-a2fe-6a5acba27aca" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.170298] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f0999f45-c89f-488f-b038-36a93b2cdeb4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.171470] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0999f45-c89f-488f-b038-36a93b2cdeb4 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.171585] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0999f45-c89f-488f-b038-36a93b2cdeb4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.171810] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 92e5af87-99c2-4c75-ab2f-1f642091d8cb with status ACTIVE [ 687.176094] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.176094] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.176094] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.176094] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.176094] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.176094] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.176094] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.176094] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.177145] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.177145] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.177145] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.177145] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.177145] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.177145] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.177145] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.177429] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 92e5af87-99c2-4c75-ab2f-1f642091d8cb is going to be updated. [ 687.206178] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.206449] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.206449] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.206898] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.206898] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.206898] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-92e5af87-99c2-4c75-ab2f-1f642091d8cb" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.525526] env[70392]: INFO networking_nsxv3.common.synchronization [req-1c6233d4-d5d4-4d86-b1f0-d6ce68901906 req-9b1cb776-f7cb-48c7-b21a-694adad4d336 tempest-FloatingIPsAssociationNegativeTestJSON-1867118597 tempest-FloatingIPsAssociationNegativeTestJSON-1867118597-project-member] Enqueued Resource ID: 623be016-3395-49f1-ae71-2a2052cde818 with Priority: HIGHEST for action security_group_members [ 687.527129] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 623be016-3395-49f1-ae71-2a2052cde818 with Priority: HIGHEST for action security_group_members [ 687.527129] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-623be016-3395-49f1-ae71-2a2052cde818 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.527129] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-623be016-3395-49f1-ae71-2a2052cde818" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.527129] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-623be016-3395-49f1-ae71-2a2052cde818" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.527556] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-623be016-3395-49f1-ae71-2a2052cde818" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.527798] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.529064] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.529064] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.529064] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.529064] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.529536] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('623be016-3395-49f1-ae71-2a2052cde818',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.533027] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59adf132-72f4-4d43-847e-1af9bc3c6073 in Status: SUCCESS [ 687.533027] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59adf132-72f4-4d43-847e-1af9bc3c6073" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.533330] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59adf132-72f4-4d43-847e-1af9bc3c6073" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.533603] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59adf132-72f4-4d43-847e-1af9bc3c6073" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.535318] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.535318] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.535318] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.535318] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.535318] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.535318] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59adf132-72f4-4d43-847e-1af9bc3c6073" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.535318] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('59adf132-72f4-4d43-847e-1af9bc3c6073',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.542794] env[70392]: INFO networking_nsxv3.common.synchronization [req-d4f47b38-3c2b-4247-abc4-e94ed4176210 req-023deee2-209b-4ac8-8aeb-75789af2a129 service nova] Enqueued Resource ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 with Priority: HIGHEST for action security_group_rules [ 687.542964] env[70392]: INFO networking_nsxv3.common.synchronization [req-d4f47b38-3c2b-4247-abc4-e94ed4176210 req-023deee2-209b-4ac8-8aeb-75789af2a129 service nova] Enqueued Resource ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 with Priority: HIGHEST for action security_group_members [ 687.543123] env[70392]: INFO networking_nsxv3.common.synchronization [req-d4f47b38-3c2b-4247-abc4-e94ed4176210 req-023deee2-209b-4ac8-8aeb-75789af2a129 service nova] Enqueued Resource ID: a0ba1014-e43f-4e2f-a2fe-6a5acba27aca with Priority: HIGHEST for action port [ 687.543611] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 with Priority: HIGHEST for action security_group_rules [ 687.543747] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 with Priority: HIGHEST for action security_group_members [ 687.543846] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0ba1014-e43f-4e2f-a2fe-6a5acba27aca with Priority: HIGHEST for action port [ 687.545782] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b60d7eaa-9583-4c75-97fa-4049c63576b6 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.545910] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.545966] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.547340] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.547340] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b60d7eaa-9583-4c75-97fa-4049c63576b6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.547721] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60d7eaa-9583-4c75-97fa-4049c63576b6 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.547721] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.547721] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.547870] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.548148] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.548148] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.548148] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.548331] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.548331] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.548432] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b60d7eaa-9583-4c75-97fa-4049c63576b6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.549344] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-a0ba1014-e43f-4e2f-a2fe-6a5acba27aca taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.549344] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a0ba1014-e43f-4e2f-a2fe-6a5acba27aca" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.549344] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a0ba1014-e43f-4e2f-a2fe-6a5acba27aca" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.549565] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a0ba1014-e43f-4e2f-a2fe-6a5acba27aca" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.549565] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a0ba1014-e43f-4e2f-a2fe-6a5acba27aca',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.682997] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f0999f45-c89f-488f-b038-36a93b2cdeb4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.738847] env[70392]: INFO networking_nsxv3.common.synchronization [None req-3418ea6b-2a86-4e50-b7a0-f34de8f7ead8 None None] Enqueued Resource ID: 57117575-9800-4327-9acf-6586198086ea with Priority: HIGHEST for action port [ 687.739454] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57117575-9800-4327-9acf-6586198086ea with Priority: HIGHEST for action port [ 687.739860] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-57117575-9800-4327-9acf-6586198086ea taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.740470] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-57117575-9800-4327-9acf-6586198086ea" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.740470] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-57117575-9800-4327-9acf-6586198086ea" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.740634] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-57117575-9800-4327-9acf-6586198086ea" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.740634] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57117575-9800-4327-9acf-6586198086ea',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.031387] env[70392]: INFO networking_nsxv3.common.synchronization [None req-f77903ea-8509-4402-82fa-d36392e85590 None None] Enqueued Resource ID: 5b8ccc87-b785-43be-8c47-003db3be89a1 with Priority: HIGHEST for action port [ 688.032753] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.033554] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.034294] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.034575] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.035355] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.035355] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.035355] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.036993] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.036993] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.036993] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.036993] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 623be016-3395-49f1-ae71-2a2052cde818 already deleted. [ 688.036993] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-623be016-3395-49f1-ae71-2a2052cde818" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.036993] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b8ccc87-b785-43be-8c47-003db3be89a1 with Priority: HIGHEST for action port [ 688.036993] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-5b8ccc87-b785-43be-8c47-003db3be89a1 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.036993] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5b8ccc87-b785-43be-8c47-003db3be89a1" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.036993] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5b8ccc87-b785-43be-8c47-003db3be89a1" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.038763] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5b8ccc87-b785-43be-8c47-003db3be89a1" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.038763] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b8ccc87-b785-43be-8c47-003db3be89a1',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.045200] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-59adf132-72f4-4d43-847e-1af9bc3c6073 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.045200] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59adf132-72f4-4d43-847e-1af9bc3c6073" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.045200] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59adf132-72f4-4d43-847e-1af9bc3c6073" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.045200] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59adf132-72f4-4d43-847e-1af9bc3c6073" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.045200] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.045200] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.045200] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.045200] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.045200] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.045883] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59adf132-72f4-4d43-847e-1af9bc3c6073" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.045883] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-59adf132-72f4-4d43-847e-1af9bc3c6073 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.045883] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59adf132-72f4-4d43-847e-1af9bc3c6073" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.045883] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59adf132-72f4-4d43-847e-1af9bc3c6073" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.045883] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59adf132-72f4-4d43-847e-1af9bc3c6073" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.045883] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.045883] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.046145] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.046145] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.046202] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.046335] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59adf132-72f4-4d43-847e-1af9bc3c6073" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.046335] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('59adf132-72f4-4d43-847e-1af9bc3c6073',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.051053] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60d7eaa-9583-4c75-97fa-4049c63576b6 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.051170] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.052557] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a0ba1014-e43f-4e2f-a2fe-6a5acba27aca with status ACTIVE [ 688.053750] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.053750] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.061191] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.061191] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.061191] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.061191] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.061191] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.061191] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.061191] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.061191] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.061191] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.061191] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.061191] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.061191] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.061191] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.061191] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a0ba1014-e43f-4e2f-a2fe-6a5acba27aca is going to be updated. [ 688.061191] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b60d7eaa-9583-4c75-97fa-4049c63576b6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.087745] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.087745] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.087745] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.087745] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.087745] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.087745] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a0ba1014-e43f-4e2f-a2fe-6a5acba27aca" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.132638] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-815 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.132839] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-815" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.133060] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-815" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.133313] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-815" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.133578] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.133750] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.133872] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.134114] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.134264] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.135026] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 688.135026] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 688.135026] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 688.135026] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 688.135026] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 688.135026] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 688.135331] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 688.159814] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 688.160139] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 688.160776] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 688.161131] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-815" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.163367] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-d7c98d24-e3eb-48aa-842e-0a619c4244a7 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.163367] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-d7c98d24-e3eb-48aa-842e-0a619c4244a7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.163367] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-d7c98d24-e3eb-48aa-842e-0a619c4244a7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.163712] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-d7c98d24-e3eb-48aa-842e-0a619c4244a7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.163978] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7c98d24-e3eb-48aa-842e-0a619c4244a7',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.187377] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.187766] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.187766] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.187864] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.188074] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.188154] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0999f45-c89f-488f-b038-36a93b2cdeb4 is going to be created. [ 688.218311] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.218311] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.218311] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.218502] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.218671] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.231371] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0999f45-c89f-488f-b038-36a93b2cdeb4 in Status: UNINITIALIZED for 2s [ 688.242492] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 57117575-9800-4327-9acf-6586198086ea [ 688.242627] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.242706] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.242844] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.242995] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.243100] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.243199] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:57117575-9800-4327-9acf-6586198086ea already deleted. [ 688.243526] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-57117575-9800-4327-9acf-6586198086ea" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.546274] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5b8ccc87-b785-43be-8c47-003db3be89a1 [ 688.546274] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.546274] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.546274] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.546274] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.546274] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.546274] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5b8ccc87-b785-43be-8c47-003db3be89a1 already deleted. [ 688.546274] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5b8ccc87-b785-43be-8c47-003db3be89a1" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.550629] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 59adf132-72f4-4d43-847e-1af9bc3c6073: rpc.has_security_group_logging(os_id): False [ 688.569541] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b60d7eaa-9583-4c75-97fa-4049c63576b6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.583031] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.583031] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.583031] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.583031] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.583031] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.583031] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.583031] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.583031] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.583031] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.583031] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.583031] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.583031] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.583031] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.583031] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.583031] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.583692] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.583692] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.583692] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.583692] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.583692] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.584044] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 59adf132-72f4-4d43-847e-1af9bc3c6073 is going to be created. [ 688.670047] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.670047] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.670047] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.670047] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.670047] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.670047] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port d7c98d24-e3eb-48aa-842e-0a619c4244a7 not found, creating... [ 688.670047] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.670047] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.670047] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.670047] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.670047] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.670667] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.674083] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.674083] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.674083] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.674083] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.674083] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: d7c98d24-e3eb-48aa-842e-0a619c4244a7 is going to be created. [ 688.822084] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.822743] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.822743] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.822743] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.823460] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.835440] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.836305] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.836493] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.837058] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.840651] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.840651] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-d7c98d24-e3eb-48aa-842e-0a619c4244a7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.841964] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 59adf132-72f4-4d43-847e-1af9bc3c6073 in Status: IN_PROGRESS for 2s [ 689.076900] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.077026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.078025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.078025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.078025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.078025] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 is going to be created. [ 689.107017] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.107017] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.107017] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.107017] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.107017] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.126374] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 in Status: UNINITIALIZED for 2s [ 689.339912] env[70392]: INFO networking_nsxv3.common.synchronization [None req-78ba4696-9a93-45e3-a14d-74f791a7d51b None None] Enqueued Resource ID: 3cb4d835-27fe-4798-8a84-ba27f274596f with Priority: HIGHEST for action port [ 689.339912] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cb4d835-27fe-4798-8a84-ba27f274596f with Priority: HIGHEST for action port [ 689.340679] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-3cb4d835-27fe-4798-8a84-ba27f274596f taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.340679] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3cb4d835-27fe-4798-8a84-ba27f274596f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.340679] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3cb4d835-27fe-4798-8a84-ba27f274596f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.340904] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3cb4d835-27fe-4798-8a84-ba27f274596f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.340958] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3cb4d835-27fe-4798-8a84-ba27f274596f',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.844414] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3cb4d835-27fe-4798-8a84-ba27f274596f [ 689.844678] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.844822] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.844897] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.845221] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.845358] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.845490] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3cb4d835-27fe-4798-8a84-ba27f274596f already deleted. [ 689.845594] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3cb4d835-27fe-4798-8a84-ba27f274596f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.018075] env[70392]: INFO networking_nsxv3.common.synchronization [None req-35497bfb-f64f-4da9-9bcf-0d589f58a10d tempest-VolumesAssistedSnapshotsTest-1612074774 tempest-VolumesAssistedSnapshotsTest-1612074774-project-member] Enqueued Resource ID: 247680ec-824d-41ac-8735-1edb7b119a99 with Priority: HIGHEST for action security_group_rules [ 690.019997] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 247680ec-824d-41ac-8735-1edb7b119a99 with Priority: HIGHEST for action security_group_rules [ 690.019997] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-247680ec-824d-41ac-8735-1edb7b119a99 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.019997] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-247680ec-824d-41ac-8735-1edb7b119a99" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.019997] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-247680ec-824d-41ac-8735-1edb7b119a99" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.020572] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-247680ec-824d-41ac-8735-1edb7b119a99" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.020572] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('247680ec-824d-41ac-8735-1edb7b119a99',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.033838] env[70392]: INFO networking_nsxv3.common.synchronization [req-1c6233d4-d5d4-4d86-b1f0-d6ce68901906 req-c87b137e-4554-4a46-804e-465fdbf90178 service nova] Enqueued Resource ID: 623be016-3395-49f1-ae71-2a2052cde818 with Priority: HIGHEST for action security_group_rules [ 690.034023] env[70392]: INFO networking_nsxv3.common.synchronization [req-1c6233d4-d5d4-4d86-b1f0-d6ce68901906 req-c87b137e-4554-4a46-804e-465fdbf90178 service nova] Enqueued Resource ID: 623be016-3395-49f1-ae71-2a2052cde818 with Priority: HIGHEST for action security_group_members [ 690.034158] env[70392]: INFO networking_nsxv3.common.synchronization [req-1c6233d4-d5d4-4d86-b1f0-d6ce68901906 req-c87b137e-4554-4a46-804e-465fdbf90178 service nova] Enqueued Resource ID: d7c98d24-e3eb-48aa-842e-0a619c4244a7 with Priority: HIGHEST for action port [ 690.034666] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 623be016-3395-49f1-ae71-2a2052cde818 with Priority: HIGHEST for action security_group_rules [ 690.038024] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 623be016-3395-49f1-ae71-2a2052cde818 with Priority: HIGHEST for action security_group_members [ 690.038024] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7c98d24-e3eb-48aa-842e-0a619c4244a7 with Priority: HIGHEST for action port [ 690.038024] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-623be016-3395-49f1-ae71-2a2052cde818 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.038024] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-623be016-3395-49f1-ae71-2a2052cde818" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.038024] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-623be016-3395-49f1-ae71-2a2052cde818" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.038024] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-623be016-3395-49f1-ae71-2a2052cde818" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.038024] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('623be016-3395-49f1-ae71-2a2052cde818',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.038024] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-623be016-3395-49f1-ae71-2a2052cde818 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.038024] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-623be016-3395-49f1-ae71-2a2052cde818" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.038024] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-623be016-3395-49f1-ae71-2a2052cde818" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.038576] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-623be016-3395-49f1-ae71-2a2052cde818" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.038576] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.038576] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.038576] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.038730] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.038730] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.038783] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('623be016-3395-49f1-ae71-2a2052cde818',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.042125] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-d7c98d24-e3eb-48aa-842e-0a619c4244a7 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.042125] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d7c98d24-e3eb-48aa-842e-0a619c4244a7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.042125] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d7c98d24-e3eb-48aa-842e-0a619c4244a7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.042125] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d7c98d24-e3eb-48aa-842e-0a619c4244a7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.042125] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7c98d24-e3eb-48aa-842e-0a619c4244a7',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.243569] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0999f45-c89f-488f-b038-36a93b2cdeb4 in Status: SUCCESS [ 690.243569] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0999f45-c89f-488f-b038-36a93b2cdeb4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.243769] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0999f45-c89f-488f-b038-36a93b2cdeb4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.244258] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0999f45-c89f-488f-b038-36a93b2cdeb4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.244489] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.244638] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.244672] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.245399] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.245399] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.245399] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0999f45-c89f-488f-b038-36a93b2cdeb4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.245399] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f0999f45-c89f-488f-b038-36a93b2cdeb4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.265694] env[70392]: INFO networking_nsxv3.common.synchronization [None req-11e96f81-c5e6-4fd3-8023-cf0ba76a3a5d tempest-VolumesAssistedSnapshotsTest-1612074774 tempest-VolumesAssistedSnapshotsTest-1612074774-project-member] Enqueued Resource ID: 247680ec-824d-41ac-8735-1edb7b119a99 with Priority: HIGHEST for action security_group_rules [ 690.265694] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 247680ec-824d-41ac-8735-1edb7b119a99 with Priority: HIGHEST for action security_group_rules [ 690.265917] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-247680ec-824d-41ac-8735-1edb7b119a99 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.265973] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-247680ec-824d-41ac-8735-1edb7b119a99" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.544610] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('623be016-3395-49f1-ae71-2a2052cde818',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.545977] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-623be016-3395-49f1-ae71-2a2052cde818 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.545977] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-623be016-3395-49f1-ae71-2a2052cde818" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.547133] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.547133] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.547133] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.547439] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.547439] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.547439] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 247680ec-824d-41ac-8735-1edb7b119a99 already deleted. [ 690.547613] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-247680ec-824d-41ac-8735-1edb7b119a99" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.547842] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d7c98d24-e3eb-48aa-842e-0a619c4244a7 with status ACTIVE [ 690.547907] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.547980] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.548025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.551636] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.551636] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.551636] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.552019] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.552019] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.552019] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.552104] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.552286] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.552363] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.552395] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.552913] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.552913] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.552913] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d7c98d24-e3eb-48aa-842e-0a619c4244a7 is going to be updated. [ 690.553685] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-247680ec-824d-41ac-8735-1edb7b119a99" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.553847] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-247680ec-824d-41ac-8735-1edb7b119a99" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.553929] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('247680ec-824d-41ac-8735-1edb7b119a99',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.585256] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.585414] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.585485] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.585694] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.585832] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.585991] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d7c98d24-e3eb-48aa-842e-0a619c4244a7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.751334] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0999f45-c89f-488f-b038-36a93b2cdeb4 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.751334] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0999f45-c89f-488f-b038-36a93b2cdeb4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.751334] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0999f45-c89f-488f-b038-36a93b2cdeb4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.751334] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0999f45-c89f-488f-b038-36a93b2cdeb4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.751334] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.751334] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.751334] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.751334] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.751334] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.751334] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0999f45-c89f-488f-b038-36a93b2cdeb4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.751334] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0999f45-c89f-488f-b038-36a93b2cdeb4 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.751334] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0999f45-c89f-488f-b038-36a93b2cdeb4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.751334] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0999f45-c89f-488f-b038-36a93b2cdeb4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.751334] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0999f45-c89f-488f-b038-36a93b2cdeb4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.751334] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.751334] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.752112] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.752112] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.752112] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.752112] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0999f45-c89f-488f-b038-36a93b2cdeb4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.752112] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f0999f45-c89f-488f-b038-36a93b2cdeb4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.861045] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 59adf132-72f4-4d43-847e-1af9bc3c6073 in Status: SUCCESS [ 690.861311] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-59adf132-72f4-4d43-847e-1af9bc3c6073" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.060279] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('623be016-3395-49f1-ae71-2a2052cde818',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.084102] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.084265] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.084335] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.084788] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.084923] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.085063] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 247680ec-824d-41ac-8735-1edb7b119a99 already deleted. [ 691.085290] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-247680ec-824d-41ac-8735-1edb7b119a99" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.138059] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 in Status: SUCCESS [ 691.138289] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.138454] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.138670] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.138858] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.138972] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.139043] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.139198] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.139275] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.139388] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.139446] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b60d7eaa-9583-4c75-97fa-4049c63576b6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.257610] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f0999f45-c89f-488f-b038-36a93b2cdeb4: rpc.has_security_group_logging(os_id): False [ 691.281457] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.281457] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.281457] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.281457] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.281457] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.281457] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.281457] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.281457] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.281457] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.281457] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.281798] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.281798] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.281798] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.281967] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.281998] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.285098] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.285098] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.285098] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.289157] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.289271] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.289371] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f0999f45-c89f-488f-b038-36a93b2cdeb4 is going to be created. [ 691.369284] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.369541] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.369648] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.369903] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.370179] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.388589] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f0999f45-c89f-488f-b038-36a93b2cdeb4 in Status: IN_PROGRESS for 2s [ 691.564129] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.564565] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.564565] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.564565] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.564678] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.564766] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 623be016-3395-49f1-ae71-2a2052cde818 is going to be created. [ 691.594066] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.594066] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.594066] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.594066] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.594066] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.602951] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 623be016-3395-49f1-ae71-2a2052cde818 in Status: UNINITIALIZED for 2s [ 691.642317] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60d7eaa-9583-4c75-97fa-4049c63576b6 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.642484] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.642614] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.642891] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.643230] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.643437] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.643437] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.643696] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.643820] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.644389] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.644389] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60d7eaa-9583-4c75-97fa-4049c63576b6 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.644389] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.644389] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.644578] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.644578] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.644655] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.644727] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.644892] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.644977] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.645462] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.645601] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b60d7eaa-9583-4c75-97fa-4049c63576b6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.981896] env[70392]: INFO networking_nsxv3.common.synchronization [None req-8362538c-b2e0-481b-adca-122a5adda1ca None None] Enqueued Resource ID: 5e83ef16-afc2-4c1c-a976-430a0a0b827b with Priority: HIGHEST for action port [ 691.985759] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e83ef16-afc2-4c1c-a976-430a0a0b827b with Priority: HIGHEST for action port [ 691.985759] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-5e83ef16-afc2-4c1c-a976-430a0a0b827b taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.985759] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5e83ef16-afc2-4c1c-a976-430a0a0b827b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.985759] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5e83ef16-afc2-4c1c-a976-430a0a0b827b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.985759] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5e83ef16-afc2-4c1c-a976-430a0a0b827b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.985759] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e83ef16-afc2-4c1c-a976-430a0a0b827b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.148342] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b60d7eaa-9583-4c75-97fa-4049c63576b6: rpc.has_security_group_logging(os_id): False [ 692.173969] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.174187] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.174347] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.175405] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.175405] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.175405] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.175405] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.175405] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.175405] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.175405] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.175823] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.175823] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.175823] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.175823] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.175823] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.176071] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.176713] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.176803] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.176970] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.177063] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.177227] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 is going to be created. [ 692.308784] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.308784] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.308784] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.308784] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.308784] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.325599] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 in Status: IN_PROGRESS for 2s [ 692.490056] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5e83ef16-afc2-4c1c-a976-430a0a0b827b [ 692.490374] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.490540] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.490611] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.490844] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.490972] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.491114] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5e83ef16-afc2-4c1c-a976-430a0a0b827b already deleted. [ 692.491167] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5e83ef16-afc2-4c1c-a976-430a0a0b827b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.516248] env[70392]: INFO networking_nsxv3.common.synchronization [req-30fe053f-5533-454e-a2d7-e510c612ca79 req-373acf26-20be-483e-a850-ba8c53e93aa3 tempest-InstanceActionsTestJSON-83943407 tempest-InstanceActionsTestJSON-83943407-project-member] Enqueued Resource ID: 5ade0934-09a2-4e5c-ac36-e235101fed11 with Priority: HIGHEST for action security_group_members [ 692.516980] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ade0934-09a2-4e5c-ac36-e235101fed11 with Priority: HIGHEST for action security_group_members [ 692.517251] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ade0934-09a2-4e5c-ac36-e235101fed11 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.517424] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ade0934-09a2-4e5c-ac36-e235101fed11" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.517484] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ade0934-09a2-4e5c-ac36-e235101fed11" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.517765] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ade0934-09a2-4e5c-ac36-e235101fed11" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.517995] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.522025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.522025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.522025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.522025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.522025] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5ade0934-09a2-4e5c-ac36-e235101fed11',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.024687] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.025729] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.025729] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.025729] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.025729] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.025729] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.025729] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.025729] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.026064] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.026064] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.028179] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ade0934-09a2-4e5c-ac36-e235101fed11 already deleted. [ 693.028179] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ade0934-09a2-4e5c-ac36-e235101fed11" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.316054] env[70392]: INFO networking_nsxv3.common.synchronization [None req-1a894c08-1048-4d09-ac10-21df92cdc291 None None] Enqueued Resource ID: a6f053b2-bb55-4801-841f-5f7b8921bccd with Priority: HIGHEST for action port [ 693.316970] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-768 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.317947] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-768" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.318175] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-768" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.323723] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-768" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.323723] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.323723] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.323723] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.324508] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.324508] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.325575] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 693.327735] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 693.327735] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 693.327735] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 693.327735] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 693.327735] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 693.327735] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 693.337410] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6f053b2-bb55-4801-841f-5f7b8921bccd with Priority: HIGHEST for action port [ 693.337410] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-a6f053b2-bb55-4801-841f-5f7b8921bccd taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.337410] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a6f053b2-bb55-4801-841f-5f7b8921bccd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.337410] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a6f053b2-bb55-4801-841f-5f7b8921bccd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.337410] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a6f053b2-bb55-4801-841f-5f7b8921bccd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.337410] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6f053b2-bb55-4801-841f-5f7b8921bccd',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.365187] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 693.365413] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.038 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 693.365527] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 693.365717] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-768" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.366077] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-115284ec-41e5-4417-b817-c1aa5812627d taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.366285] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-115284ec-41e5-4417-b817-c1aa5812627d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.366472] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-115284ec-41e5-4417-b817-c1aa5812627d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.366880] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-115284ec-41e5-4417-b817-c1aa5812627d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.368257] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('115284ec-41e5-4417-b817-c1aa5812627d',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.427708] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f0999f45-c89f-488f-b038-36a93b2cdeb4 in Status: SUCCESS [ 693.427952] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f0999f45-c89f-488f-b038-36a93b2cdeb4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.464353] env[70392]: INFO networking_nsxv3.common.synchronization [None req-a1e2b793-79a4-48b4-801b-867c6a68be31 tempest-ServersWithSpecificFlavorTestJSON-1944551370 tempest-ServersWithSpecificFlavorTestJSON-1944551370-project-member] Enqueued Resource ID: 7f78f149-d978-4089-8aa8-d480e7d7bb61 with Priority: HIGHEST for action security_group_rules [ 693.464946] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f78f149-d978-4089-8aa8-d480e7d7bb61 with Priority: HIGHEST for action security_group_rules [ 693.465386] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f78f149-d978-4089-8aa8-d480e7d7bb61 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.465667] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f78f149-d978-4089-8aa8-d480e7d7bb61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.465667] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f78f149-d978-4089-8aa8-d480e7d7bb61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.465932] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f78f149-d978-4089-8aa8-d480e7d7bb61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.466035] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f78f149-d978-4089-8aa8-d480e7d7bb61',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.619987] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 623be016-3395-49f1-ae71-2a2052cde818 in Status: SUCCESS [ 693.620871] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-623be016-3395-49f1-ae71-2a2052cde818" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.620871] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-623be016-3395-49f1-ae71-2a2052cde818" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.620871] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-623be016-3395-49f1-ae71-2a2052cde818" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.620871] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.621164] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.621164] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.621284] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.621328] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.621405] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-623be016-3395-49f1-ae71-2a2052cde818" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.621497] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('623be016-3395-49f1-ae71-2a2052cde818',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.843242] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a6f053b2-bb55-4801-841f-5f7b8921bccd [ 693.843242] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.843487] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.843487] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.843548] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.843781] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.843781] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a6f053b2-bb55-4801-841f-5f7b8921bccd already deleted. [ 693.843851] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a6f053b2-bb55-4801-841f-5f7b8921bccd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.872703] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.872992] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.873119] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.873426] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.873592] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.873767] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 115284ec-41e5-4417-b817-c1aa5812627d not found, creating... [ 693.874110] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.874278] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.874435] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.874697] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.875637] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.876042] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.876268] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.876325] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.876560] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.876704] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.876856] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 115284ec-41e5-4417-b817-c1aa5812627d is going to be created. [ 693.904317] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.904317] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.904317] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.904564] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.904738] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.905410] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-115284ec-41e5-4417-b817-c1aa5812627d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.920266] env[70392]: INFO networking_nsxv3.common.synchronization [None req-3185eac6-b4cf-4c1a-8081-5fbd9cebb771 tempest-ServersWithSpecificFlavorTestJSON-1944551370 tempest-ServersWithSpecificFlavorTestJSON-1944551370-project-member] Enqueued Resource ID: 7f78f149-d978-4089-8aa8-d480e7d7bb61 with Priority: HIGHEST for action security_group_rules [ 693.920800] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f78f149-d978-4089-8aa8-d480e7d7bb61 with Priority: HIGHEST for action security_group_rules [ 693.921995] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f78f149-d978-4089-8aa8-d480e7d7bb61 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.921995] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f78f149-d978-4089-8aa8-d480e7d7bb61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.996564] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.996564] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.996564] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.996564] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.996564] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.996564] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f78f149-d978-4089-8aa8-d480e7d7bb61 already deleted. [ 693.996564] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f78f149-d978-4089-8aa8-d480e7d7bb61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.996564] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f78f149-d978-4089-8aa8-d480e7d7bb61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.996564] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f78f149-d978-4089-8aa8-d480e7d7bb61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.996564] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f78f149-d978-4089-8aa8-d480e7d7bb61',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.125520] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-623be016-3395-49f1-ae71-2a2052cde818 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.125838] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-623be016-3395-49f1-ae71-2a2052cde818" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.125838] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-623be016-3395-49f1-ae71-2a2052cde818" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.126152] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-623be016-3395-49f1-ae71-2a2052cde818" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.126537] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.126537] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.126537] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.126729] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.126763] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.126855] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-623be016-3395-49f1-ae71-2a2052cde818" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.127048] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-623be016-3395-49f1-ae71-2a2052cde818 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.127402] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-623be016-3395-49f1-ae71-2a2052cde818" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.127402] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-623be016-3395-49f1-ae71-2a2052cde818" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.127402] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-623be016-3395-49f1-ae71-2a2052cde818" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.127569] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.127569] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.127668] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.127786] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.127820] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.127906] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-623be016-3395-49f1-ae71-2a2052cde818" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.128011] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('623be016-3395-49f1-ae71-2a2052cde818',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.205326] env[70392]: INFO networking_nsxv3.common.synchronization [None req-9fca5ce4-a7ba-4ad4-9a00-7873b1baf157 None None] Enqueued Resource ID: c3ccefab-c79f-4ed2-9d0e-46a4799d48fd with Priority: HIGHEST for action port [ 694.206867] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3ccefab-c79f-4ed2-9d0e-46a4799d48fd with Priority: HIGHEST for action port [ 694.213108] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-c3ccefab-c79f-4ed2-9d0e-46a4799d48fd taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.213108] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c3ccefab-c79f-4ed2-9d0e-46a4799d48fd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.213108] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c3ccefab-c79f-4ed2-9d0e-46a4799d48fd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.213108] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c3ccefab-c79f-4ed2-9d0e-46a4799d48fd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.213108] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3ccefab-c79f-4ed2-9d0e-46a4799d48fd',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.344985] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 in Status: SUCCESS [ 694.344985] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.532330] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.532330] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.532330] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.532330] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.532330] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.532330] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f78f149-d978-4089-8aa8-d480e7d7bb61 already deleted. [ 694.532330] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f78f149-d978-4089-8aa8-d480e7d7bb61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.632765] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 623be016-3395-49f1-ae71-2a2052cde818: rpc.has_security_group_logging(os_id): False [ 694.651516] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.651668] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.651741] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.651950] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.652156] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.652271] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.652370] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.652434] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.652586] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.652666] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.652839] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.652933] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.652997] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.653158] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.653235] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.654654] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.654654] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.654654] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.654654] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.654654] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.654654] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 623be016-3395-49f1-ae71-2a2052cde818 is going to be created. [ 694.712774] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c3ccefab-c79f-4ed2-9d0e-46a4799d48fd [ 694.712967] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.713108] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.713186] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.713468] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.713508] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.713587] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c3ccefab-c79f-4ed2-9d0e-46a4799d48fd already deleted. [ 694.713674] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c3ccefab-c79f-4ed2-9d0e-46a4799d48fd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.746017] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.746150] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.746188] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.747561] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.747781] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.766112] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 623be016-3395-49f1-ae71-2a2052cde818 in Status: IN_PROGRESS for 2s [ 694.904965] env[70392]: INFO networking_nsxv3.common.synchronization [req-1b784e09-02b2-4f27-9a43-293ce451a276 req-0902e605-8969-43e8-a8ff-12413fc4a621 tempest-DeleteServersTestJSON-1676313022 tempest-DeleteServersTestJSON-1676313022-project-member] Enqueued Resource ID: ce79170a-31ce-429e-8e08-a911557872f4 with Priority: HIGHEST for action security_group_members [ 694.905520] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce79170a-31ce-429e-8e08-a911557872f4 with Priority: HIGHEST for action security_group_members [ 694.905830] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce79170a-31ce-429e-8e08-a911557872f4 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.905947] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.906701] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.907033] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.907209] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.907330] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.907399] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.907572] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.907657] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.907751] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce79170a-31ce-429e-8e08-a911557872f4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.412963] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.413273] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.413273] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.413531] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.413625] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.413831] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.413931] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.413996] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.414161] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.414241] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.414328] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce79170a-31ce-429e-8e08-a911557872f4 already deleted. [ 695.414408] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.522391] env[70392]: INFO networking_nsxv3.common.synchronization [req-30fe053f-5533-454e-a2d7-e510c612ca79 req-bb2bb6f2-98bf-4596-bf20-5597b055f9a5 service nova] Enqueued Resource ID: 5ade0934-09a2-4e5c-ac36-e235101fed11 with Priority: HIGHEST for action security_group_rules [ 695.522391] env[70392]: INFO networking_nsxv3.common.synchronization [req-30fe053f-5533-454e-a2d7-e510c612ca79 req-bb2bb6f2-98bf-4596-bf20-5597b055f9a5 service nova] Enqueued Resource ID: 5ade0934-09a2-4e5c-ac36-e235101fed11 with Priority: HIGHEST for action security_group_members [ 695.522391] env[70392]: INFO networking_nsxv3.common.synchronization [req-30fe053f-5533-454e-a2d7-e510c612ca79 req-bb2bb6f2-98bf-4596-bf20-5597b055f9a5 service nova] Enqueued Resource ID: 115284ec-41e5-4417-b817-c1aa5812627d with Priority: HIGHEST for action port [ 695.522391] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ade0934-09a2-4e5c-ac36-e235101fed11 with Priority: HIGHEST for action security_group_rules [ 695.522391] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ade0934-09a2-4e5c-ac36-e235101fed11 with Priority: HIGHEST for action security_group_members [ 695.522391] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 115284ec-41e5-4417-b817-c1aa5812627d with Priority: HIGHEST for action port [ 695.526535] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5ade0934-09a2-4e5c-ac36-e235101fed11 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.526535] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5ade0934-09a2-4e5c-ac36-e235101fed11" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.526535] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5ade0934-09a2-4e5c-ac36-e235101fed11" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.526871] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5ade0934-09a2-4e5c-ac36-e235101fed11" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.526871] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5ade0934-09a2-4e5c-ac36-e235101fed11',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.528222] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ade0934-09a2-4e5c-ac36-e235101fed11 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.528395] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ade0934-09a2-4e5c-ac36-e235101fed11" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.528473] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ade0934-09a2-4e5c-ac36-e235101fed11" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.528728] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ade0934-09a2-4e5c-ac36-e235101fed11" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.528879] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.532025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.532025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.532025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.532025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.532025] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5ade0934-09a2-4e5c-ac36-e235101fed11',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.532025] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-115284ec-41e5-4417-b817-c1aa5812627d taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.532025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-115284ec-41e5-4417-b817-c1aa5812627d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.532025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-115284ec-41e5-4417-b817-c1aa5812627d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.532025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-115284ec-41e5-4417-b817-c1aa5812627d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.532781] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('115284ec-41e5-4417-b817-c1aa5812627d',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.035535] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5ade0934-09a2-4e5c-ac36-e235101fed11',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.036669] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ade0934-09a2-4e5c-ac36-e235101fed11 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.036847] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ade0934-09a2-4e5c-ac36-e235101fed11" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.037118] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 115284ec-41e5-4417-b817-c1aa5812627d with status ACTIVE [ 696.037401] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.037401] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.037401] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.037519] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.037964] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.037964] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.037964] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.037964] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.038175] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.038175] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.038752] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.038752] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.038752] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.038752] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.038752] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.039065] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 115284ec-41e5-4417-b817-c1aa5812627d is going to be updated. [ 696.064253] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.064895] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.064895] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.064895] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.065070] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.065242] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-115284ec-41e5-4417-b817-c1aa5812627d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.155764] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-422 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.156050] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-422" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.159075] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-422" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.159075] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-422" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.159075] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.159075] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.159075] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.159075] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.159075] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.159075] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 696.159075] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 696.159075] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 696.160538] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 696.160538] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 696.160538] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 696.160538] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 696.190491] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 696.190809] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 696.191134] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 696.191464] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-422" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.192050] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-b8e0508c-9617-46e8-9c81-da42c17cb519 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.192263] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-b8e0508c-9617-46e8-9c81-da42c17cb519" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.192429] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-b8e0508c-9617-46e8-9c81-da42c17cb519" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.192783] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-b8e0508c-9617-46e8-9c81-da42c17cb519" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.192963] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8e0508c-9617-46e8-9c81-da42c17cb519',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.544184] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5ade0934-09a2-4e5c-ac36-e235101fed11',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.702509] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.704933] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.704933] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.704933] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.704933] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.704933] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port b8e0508c-9617-46e8-9c81-da42c17cb519 not found, creating... [ 696.704933] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.704933] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.704933] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.704933] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.704933] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.706322] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.706540] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.706679] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.706937] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.707203] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.707374] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: b8e0508c-9617-46e8-9c81-da42c17cb519 is going to be created. [ 696.734482] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.734745] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.734944] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.735351] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.735550] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.735800] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-b8e0508c-9617-46e8-9c81-da42c17cb519" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.785279] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 623be016-3395-49f1-ae71-2a2052cde818 in Status: SUCCESS [ 696.785513] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-623be016-3395-49f1-ae71-2a2052cde818" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.049468] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.050551] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.050614] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.052455] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.052455] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.052455] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ade0934-09a2-4e5c-ac36-e235101fed11 is going to be created. [ 697.099090] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.099260] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.099354] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.099545] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.099734] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.120095] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ade0934-09a2-4e5c-ac36-e235101fed11 in Status: UNINITIALIZED for 2s [ 697.189941] env[70392]: INFO networking_nsxv3.common.synchronization [None req-3d9fdb8e-8f7c-4c8d-a5bd-472984e17ae7 None None] Enqueued Resource ID: 518717a3-a606-423a-a2d7-fa589648d5e1 with Priority: HIGHEST for action port [ 697.190782] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 518717a3-a606-423a-a2d7-fa589648d5e1 with Priority: HIGHEST for action port [ 697.193705] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-518717a3-a606-423a-a2d7-fa589648d5e1 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.193705] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-518717a3-a606-423a-a2d7-fa589648d5e1" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.193705] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-518717a3-a606-423a-a2d7-fa589648d5e1" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.193705] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-518717a3-a606-423a-a2d7-fa589648d5e1" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.193705] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('518717a3-a606-423a-a2d7-fa589648d5e1',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.666632] env[70392]: INFO networking_nsxv3.common.synchronization [None req-bf77e27c-2423-4d37-b74d-0895f6d3690f None None] Enqueued Resource ID: 7af618af-dedb-478e-bb4e-3b76500d868a with Priority: HIGHEST for action port [ 697.666632] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7af618af-dedb-478e-bb4e-3b76500d868a with Priority: HIGHEST for action port [ 697.666632] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-7af618af-dedb-478e-bb4e-3b76500d868a taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.666632] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7af618af-dedb-478e-bb4e-3b76500d868a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.666632] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7af618af-dedb-478e-bb4e-3b76500d868a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.667785] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7af618af-dedb-478e-bb4e-3b76500d868a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.667785] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7af618af-dedb-478e-bb4e-3b76500d868a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.695492] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 518717a3-a606-423a-a2d7-fa589648d5e1 [ 697.695789] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.695926] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.695987] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.696985] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.696985] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.696985] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:518717a3-a606-423a-a2d7-fa589648d5e1 already deleted. [ 697.696985] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-518717a3-a606-423a-a2d7-fa589648d5e1" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.154508] env[70392]: INFO networking_nsxv3.common.synchronization [None req-7759dc2f-c6c8-4c3a-a1ca-ed67d9bda5ab None None] Enqueued Resource ID: 555b1431-bf0d-4cb0-9890-e98374fedd78 with Priority: HIGHEST for action port [ 698.158629] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 555b1431-bf0d-4cb0-9890-e98374fedd78 with Priority: HIGHEST for action port [ 698.159219] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-555b1431-bf0d-4cb0-9890-e98374fedd78 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.159371] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-555b1431-bf0d-4cb0-9890-e98374fedd78" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.159447] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-555b1431-bf0d-4cb0-9890-e98374fedd78" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.159721] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-555b1431-bf0d-4cb0-9890-e98374fedd78" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.159800] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('555b1431-bf0d-4cb0-9890-e98374fedd78',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.169806] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7af618af-dedb-478e-bb4e-3b76500d868a [ 698.170120] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.170308] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.173021] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.173021] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.173021] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.173021] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7af618af-dedb-478e-bb4e-3b76500d868a already deleted. [ 698.173021] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7af618af-dedb-478e-bb4e-3b76500d868a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.427414] env[70392]: INFO networking_nsxv3.common.synchronization [req-1b784e09-02b2-4f27-9a43-293ce451a276 req-056fd423-cd00-4768-9f5d-b5ef148a1bb6 service nova] Enqueued Resource ID: ce79170a-31ce-429e-8e08-a911557872f4 with Priority: HIGHEST for action security_group_rules [ 698.428280] env[70392]: INFO networking_nsxv3.common.synchronization [req-1b784e09-02b2-4f27-9a43-293ce451a276 req-056fd423-cd00-4768-9f5d-b5ef148a1bb6 service nova] Enqueued Resource ID: ce79170a-31ce-429e-8e08-a911557872f4 with Priority: HIGHEST for action security_group_members [ 698.428280] env[70392]: INFO networking_nsxv3.common.synchronization [req-1b784e09-02b2-4f27-9a43-293ce451a276 req-056fd423-cd00-4768-9f5d-b5ef148a1bb6 service nova] Enqueued Resource ID: b8e0508c-9617-46e8-9c81-da42c17cb519 with Priority: HIGHEST for action port [ 698.432741] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce79170a-31ce-429e-8e08-a911557872f4 with Priority: HIGHEST for action security_group_rules [ 698.432741] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce79170a-31ce-429e-8e08-a911557872f4 with Priority: HIGHEST for action security_group_members [ 698.432741] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8e0508c-9617-46e8-9c81-da42c17cb519 with Priority: HIGHEST for action port [ 698.432741] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ce79170a-31ce-429e-8e08-a911557872f4 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.432741] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.432741] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.432741] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.432741] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ce79170a-31ce-429e-8e08-a911557872f4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.432741] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce79170a-31ce-429e-8e08-a911557872f4 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.432741] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.432741] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.433514] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.434369] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.434369] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.434369] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.434369] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.434369] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.434369] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce79170a-31ce-429e-8e08-a911557872f4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.435892] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-b8e0508c-9617-46e8-9c81-da42c17cb519 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.435892] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b8e0508c-9617-46e8-9c81-da42c17cb519" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.435892] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b8e0508c-9617-46e8-9c81-da42c17cb519" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.435892] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b8e0508c-9617-46e8-9c81-da42c17cb519" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.435892] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8e0508c-9617-46e8-9c81-da42c17cb519',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.661927] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 555b1431-bf0d-4cb0-9890-e98374fedd78 [ 698.662271] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.662428] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.662500] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.662717] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.662810] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.662907] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:555b1431-bf0d-4cb0-9890-e98374fedd78 already deleted. [ 698.662989] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-555b1431-bf0d-4cb0-9890-e98374fedd78" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.941629] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce79170a-31ce-429e-8e08-a911557872f4 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.941629] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.941629] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b8e0508c-9617-46e8-9c81-da42c17cb519 with status ACTIVE [ 698.941629] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.941629] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.945152] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.945152] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.945152] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.945152] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.945152] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.945152] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.945152] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.945152] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.945152] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.945152] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.945152] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.945152] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.945152] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.945152] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b8e0508c-9617-46e8-9c81-da42c17cb519 is going to be updated. [ 698.949243] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ce79170a-31ce-429e-8e08-a911557872f4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.982940] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.984250] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.984482] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.984751] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.984936] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.985122] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b8e0508c-9617-46e8-9c81-da42c17cb519" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.146236] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ade0934-09a2-4e5c-ac36-e235101fed11 in Status: SUCCESS [ 699.146236] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ade0934-09a2-4e5c-ac36-e235101fed11" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.146236] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ade0934-09a2-4e5c-ac36-e235101fed11" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.146236] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ade0934-09a2-4e5c-ac36-e235101fed11" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.146236] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.146236] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.146236] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.146236] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.146236] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.146236] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ade0934-09a2-4e5c-ac36-e235101fed11" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.146236] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5ade0934-09a2-4e5c-ac36-e235101fed11',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.455817] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ce79170a-31ce-429e-8e08-a911557872f4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.654915] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ade0934-09a2-4e5c-ac36-e235101fed11 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.654915] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ade0934-09a2-4e5c-ac36-e235101fed11" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.654915] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ade0934-09a2-4e5c-ac36-e235101fed11" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.655187] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ade0934-09a2-4e5c-ac36-e235101fed11" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.655802] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.655917] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.655985] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.656655] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.656655] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.656749] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ade0934-09a2-4e5c-ac36-e235101fed11" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.656915] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ade0934-09a2-4e5c-ac36-e235101fed11 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.657071] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ade0934-09a2-4e5c-ac36-e235101fed11" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.657191] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ade0934-09a2-4e5c-ac36-e235101fed11" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.657298] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ade0934-09a2-4e5c-ac36-e235101fed11" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.657579] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.657579] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.657579] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.657739] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.658048] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.658048] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ade0934-09a2-4e5c-ac36-e235101fed11" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.658048] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5ade0934-09a2-4e5c-ac36-e235101fed11',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.960556] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.961140] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.961140] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.961262] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.961343] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.961451] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce79170a-31ce-429e-8e08-a911557872f4 is going to be created. [ 699.992561] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.992847] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.992975] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.993237] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.993436] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.007543] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce79170a-31ce-429e-8e08-a911557872f4 in Status: UNINITIALIZED for 2s [ 700.162763] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5ade0934-09a2-4e5c-ac36-e235101fed11: rpc.has_security_group_logging(os_id): False [ 700.199755] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.200722] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.201501] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.201750] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.202449] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.203327] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.203327] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.203327] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.207034] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.207034] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.207034] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.207034] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.207034] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.207034] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.207034] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.207034] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.207034] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.207034] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.207034] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.207034] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.207034] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5ade0934-09a2-4e5c-ac36-e235101fed11 is going to be created. [ 700.294289] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.294521] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.294577] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.294858] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.295186] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.309670] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5ade0934-09a2-4e5c-ac36-e235101fed11 in Status: IN_PROGRESS for 2s [ 700.430062] env[70392]: INFO networking_nsxv3.common.synchronization [None req-c192486e-ac97-45b1-ae25-7f96bcff39fe None None] Enqueued Resource ID: c8b73efe-1aa7-4b8e-8313-246ae5219eca with Priority: HIGHEST for action port [ 700.430960] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8b73efe-1aa7-4b8e-8313-246ae5219eca with Priority: HIGHEST for action port [ 700.433096] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-c8b73efe-1aa7-4b8e-8313-246ae5219eca taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.433096] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c8b73efe-1aa7-4b8e-8313-246ae5219eca" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.433096] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c8b73efe-1aa7-4b8e-8313-246ae5219eca" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.433096] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c8b73efe-1aa7-4b8e-8313-246ae5219eca" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.433096] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c8b73efe-1aa7-4b8e-8313-246ae5219eca',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.915947] env[70392]: INFO networking_nsxv3.common.synchronization [None req-60822703-4966-4f33-9cc2-5890678bf4a9 None None] Enqueued Resource ID: 92cbc2a3-3de7-4397-944f-727267c6c72a with Priority: HIGHEST for action port [ 700.916058] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92cbc2a3-3de7-4397-944f-727267c6c72a with Priority: HIGHEST for action port [ 700.916435] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-92cbc2a3-3de7-4397-944f-727267c6c72a taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.916556] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-92cbc2a3-3de7-4397-944f-727267c6c72a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.916556] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-92cbc2a3-3de7-4397-944f-727267c6c72a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.917500] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-92cbc2a3-3de7-4397-944f-727267c6c72a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.917500] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92cbc2a3-3de7-4397-944f-727267c6c72a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.936232] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c8b73efe-1aa7-4b8e-8313-246ae5219eca [ 700.937013] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.937247] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.937353] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.937641] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.938041] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.938334] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c8b73efe-1aa7-4b8e-8313-246ae5219eca already deleted. [ 700.938569] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c8b73efe-1aa7-4b8e-8313-246ae5219eca" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.316632] env[70392]: INFO networking_nsxv3.common.synchronization [req-97b78261-9058-4ec4-b26c-7cb8f3f3bde7 req-55cd454a-6310-44c4-87fc-bcf7c56d1336 tempest-ServerDiagnosticsTest-636566878 tempest-ServerDiagnosticsTest-636566878-project-member] Enqueued Resource ID: 440b9e9c-7b34-46fd-9988-db4bdb111a55 with Priority: HIGHEST for action security_group_members [ 701.317839] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 440b9e9c-7b34-46fd-9988-db4bdb111a55 with Priority: HIGHEST for action security_group_members [ 701.318293] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-440b9e9c-7b34-46fd-9988-db4bdb111a55 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.318490] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-440b9e9c-7b34-46fd-9988-db4bdb111a55" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.318553] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-440b9e9c-7b34-46fd-9988-db4bdb111a55" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.318792] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-440b9e9c-7b34-46fd-9988-db4bdb111a55" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.319689] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.319796] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.319864] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.320124] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.320202] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.320302] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('440b9e9c-7b34-46fd-9988-db4bdb111a55',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.420496] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 92cbc2a3-3de7-4397-944f-727267c6c72a [ 701.422347] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.422624] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.422740] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.423104] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.423230] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.425425] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:92cbc2a3-3de7-4397-944f-727267c6c72a already deleted. [ 701.425645] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-92cbc2a3-3de7-4397-944f-727267c6c72a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.830142] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.830142] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.830142] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.830142] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.830142] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.830142] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.830142] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.830142] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.830142] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.830142] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.830142] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 440b9e9c-7b34-46fd-9988-db4bdb111a55 already deleted. [ 701.830142] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-440b9e9c-7b34-46fd-9988-db4bdb111a55" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.021021] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce79170a-31ce-429e-8e08-a911557872f4 in Status: SUCCESS [ 702.023846] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.023846] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.023846] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.023846] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.023846] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.023846] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.023846] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.023846] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.023846] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.024432] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ce79170a-31ce-429e-8e08-a911557872f4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.324415] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5ade0934-09a2-4e5c-ac36-e235101fed11 in Status: SUCCESS [ 702.324733] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5ade0934-09a2-4e5c-ac36-e235101fed11" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.412736] env[70392]: INFO networking_nsxv3.common.synchronization [None req-35383983-a173-4216-8ccc-92288893149e None None] Enqueued Resource ID: a936b543-66c5-40ec-824c-29fc0904f88f with Priority: HIGHEST for action port [ 702.415509] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a936b543-66c5-40ec-824c-29fc0904f88f with Priority: HIGHEST for action port [ 702.415909] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-a936b543-66c5-40ec-824c-29fc0904f88f taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.417372] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a936b543-66c5-40ec-824c-29fc0904f88f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.417372] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a936b543-66c5-40ec-824c-29fc0904f88f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.417685] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a936b543-66c5-40ec-824c-29fc0904f88f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.417685] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a936b543-66c5-40ec-824c-29fc0904f88f',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.529794] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce79170a-31ce-429e-8e08-a911557872f4 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.530153] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.530218] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.530509] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.530771] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.530953] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.531869] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.531869] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.531869] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.531869] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.532132] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce79170a-31ce-429e-8e08-a911557872f4 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.532132] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.532132] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.532667] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.532667] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.532809] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.532919] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.535139] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.535757] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.535757] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.535757] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ce79170a-31ce-429e-8e08-a911557872f4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.919629] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a936b543-66c5-40ec-824c-29fc0904f88f [ 702.919879] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.920029] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.920101] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.920331] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.920435] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.920557] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a936b543-66c5-40ec-824c-29fc0904f88f already deleted. [ 702.920648] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a936b543-66c5-40ec-824c-29fc0904f88f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.038369] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ce79170a-31ce-429e-8e08-a911557872f4: rpc.has_security_group_logging(os_id): False [ 703.062671] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.063077] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.063284] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.063978] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.064940] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.065306] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.065556] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.068314] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.068314] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.068314] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.068314] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.068314] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.068314] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.068314] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.068314] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.068314] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.068314] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.068314] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.068314] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.068314] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.068314] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ce79170a-31ce-429e-8e08-a911557872f4 is going to be created. [ 703.137385] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.137385] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.137385] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.137385] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.137385] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.153600] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ce79170a-31ce-429e-8e08-a911557872f4 in Status: IN_PROGRESS for 2s [ 703.354336] env[70392]: INFO networking_nsxv3.common.synchronization [None req-61839ade-3d2e-422b-bdc0-fa02515d3c77 tempest-ServersTestFqdnHostnames-1925581123 tempest-ServersTestFqdnHostnames-1925581123-project-member] Enqueued Resource ID: cca6e4dd-68c9-4fd2-8e1a-cda645da02e4 with Priority: HIGHEST for action security_group_rules [ 703.356432] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cca6e4dd-68c9-4fd2-8e1a-cda645da02e4 with Priority: HIGHEST for action security_group_rules [ 703.356843] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cca6e4dd-68c9-4fd2-8e1a-cda645da02e4 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.357149] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cca6e4dd-68c9-4fd2-8e1a-cda645da02e4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.357205] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cca6e4dd-68c9-4fd2-8e1a-cda645da02e4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.357523] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cca6e4dd-68c9-4fd2-8e1a-cda645da02e4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.357622] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cca6e4dd-68c9-4fd2-8e1a-cda645da02e4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.598516] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-325 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.598516] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-325" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.598516] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-325" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.598516] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-325" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.598922] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.598922] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.599163] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.599270] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.599469] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.599735] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 703.599849] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 703.600022] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 703.600242] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 703.600398] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 703.600524] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 703.600681] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 703.649599] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 703.649599] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.048 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 703.649599] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 703.649599] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-325" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.649599] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-270159ed-9fd0-4347-b03f-33b46c6194f1 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.649599] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-270159ed-9fd0-4347-b03f-33b46c6194f1" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.649914] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-270159ed-9fd0-4347-b03f-33b46c6194f1" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.651676] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-270159ed-9fd0-4347-b03f-33b46c6194f1" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.651676] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('270159ed-9fd0-4347-b03f-33b46c6194f1',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.884117] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.884117] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.884117] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.884646] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.884831] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.885179] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cca6e4dd-68c9-4fd2-8e1a-cda645da02e4 already deleted. [ 703.885326] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cca6e4dd-68c9-4fd2-8e1a-cda645da02e4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.015585] env[70392]: INFO networking_nsxv3.common.synchronization [None req-567125e7-d176-49aa-afaf-e48452a981c5 tempest-ServersTestFqdnHostnames-1925581123 tempest-ServersTestFqdnHostnames-1925581123-project-member] Enqueued Resource ID: cca6e4dd-68c9-4fd2-8e1a-cda645da02e4 with Priority: HIGHEST for action security_group_rules [ 704.018402] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cca6e4dd-68c9-4fd2-8e1a-cda645da02e4 with Priority: HIGHEST for action security_group_rules [ 704.018842] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cca6e4dd-68c9-4fd2-8e1a-cda645da02e4 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.018928] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cca6e4dd-68c9-4fd2-8e1a-cda645da02e4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.019048] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cca6e4dd-68c9-4fd2-8e1a-cda645da02e4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.019427] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cca6e4dd-68c9-4fd2-8e1a-cda645da02e4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.019427] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cca6e4dd-68c9-4fd2-8e1a-cda645da02e4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.156812] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.156812] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.156812] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.156812] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.156812] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.156812] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 270159ed-9fd0-4347-b03f-33b46c6194f1 not found, creating... [ 704.156812] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.156812] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.156812] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.156812] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.156812] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.157385] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.158349] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.158962] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.158962] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.158962] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.159107] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 270159ed-9fd0-4347-b03f-33b46c6194f1 is going to be created. [ 704.189052] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.189052] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.189052] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.189052] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.189548] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.189548] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-270159ed-9fd0-4347-b03f-33b46c6194f1" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.544052] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.544052] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.544052] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.544052] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.544052] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.544052] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cca6e4dd-68c9-4fd2-8e1a-cda645da02e4 already deleted. [ 704.544052] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cca6e4dd-68c9-4fd2-8e1a-cda645da02e4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.653868] env[70392]: INFO networking_nsxv3.common.synchronization [None req-1d445757-b329-4f2c-a5d2-9a8244051caf None None] Enqueued Resource ID: a61d80dc-aa94-4228-958d-0466a32ad7cd with Priority: HIGHEST for action port [ 704.657066] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a61d80dc-aa94-4228-958d-0466a32ad7cd with Priority: HIGHEST for action port [ 704.657472] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-a61d80dc-aa94-4228-958d-0466a32ad7cd taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.657590] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a61d80dc-aa94-4228-958d-0466a32ad7cd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.657660] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a61d80dc-aa94-4228-958d-0466a32ad7cd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.657928] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a61d80dc-aa94-4228-958d-0466a32ad7cd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.658463] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a61d80dc-aa94-4228-958d-0466a32ad7cd',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.879335] env[70392]: INFO networking_nsxv3.common.synchronization [req-d4dbfac2-b8d9-4597-8e52-17b089a1e8cc req-99d72240-fd60-4b01-ad2e-b3221034baf9 tempest-MigrationsAdminTest-1525374997 tempest-MigrationsAdminTest-1525374997-project-member] Enqueued Resource ID: 5fec7002-3137-40f1-a653-f520126396a2 with Priority: HIGHEST for action security_group_members [ 704.880457] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fec7002-3137-40f1-a653-f520126396a2 with Priority: HIGHEST for action security_group_members [ 704.880675] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fec7002-3137-40f1-a653-f520126396a2 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.880675] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.880769] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.884037] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.884037] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.884037] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.884037] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.884037] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.884037] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.884037] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5fec7002-3137-40f1-a653-f520126396a2',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.098593] env[70392]: INFO networking_nsxv3.common.synchronization [None req-63431d83-cb47-4a71-a444-91a7f97ba752 None None] Enqueued Resource ID: a59e99a9-3508-4ddd-9a3a-396d4c342e2c with Priority: HIGHEST for action port [ 705.099930] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a59e99a9-3508-4ddd-9a3a-396d4c342e2c with Priority: HIGHEST for action port [ 705.100260] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-a59e99a9-3508-4ddd-9a3a-396d4c342e2c taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.101033] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a59e99a9-3508-4ddd-9a3a-396d4c342e2c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.101033] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a59e99a9-3508-4ddd-9a3a-396d4c342e2c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.101221] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a59e99a9-3508-4ddd-9a3a-396d4c342e2c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.101221] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a59e99a9-3508-4ddd-9a3a-396d4c342e2c',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.163908] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a61d80dc-aa94-4228-958d-0466a32ad7cd [ 705.163908] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.163908] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.163908] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.163908] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.163908] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.163908] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a61d80dc-aa94-4228-958d-0466a32ad7cd already deleted. [ 705.163908] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a61d80dc-aa94-4228-958d-0466a32ad7cd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.174205] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ce79170a-31ce-429e-8e08-a911557872f4 in Status: SUCCESS [ 705.174205] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.386393] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.386577] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.389022] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.389022] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.389022] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.389022] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.389022] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.389022] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.389022] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.389022] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.389022] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5fec7002-3137-40f1-a653-f520126396a2 already deleted. [ 705.389022] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.603409] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a59e99a9-3508-4ddd-9a3a-396d4c342e2c [ 705.603744] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.603827] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.603868] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.604092] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.604182] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.604303] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a59e99a9-3508-4ddd-9a3a-396d4c342e2c already deleted. [ 705.604474] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a59e99a9-3508-4ddd-9a3a-396d4c342e2c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.740078] env[70392]: INFO networking_nsxv3.common.synchronization [req-ee8563f1-8d90-4fba-bd6e-47d47428b805 req-6d3f81d1-e0ff-4e0d-b778-ed8621156ad4 tempest-DeleteServersAdminTestJSON-100473431 tempest-DeleteServersAdminTestJSON-100473431-project-admin] Enqueued Resource ID: f0999f45-c89f-488f-b038-36a93b2cdeb4 with Priority: HIGHEST for action security_group_members [ 705.740518] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0999f45-c89f-488f-b038-36a93b2cdeb4 with Priority: HIGHEST for action security_group_members [ 705.740839] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0999f45-c89f-488f-b038-36a93b2cdeb4 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.741157] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0999f45-c89f-488f-b038-36a93b2cdeb4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.741157] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0999f45-c89f-488f-b038-36a93b2cdeb4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.741487] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0999f45-c89f-488f-b038-36a93b2cdeb4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.741487] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.741487] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.741639] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.741680] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.741746] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.741839] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0999f45-c89f-488f-b038-36a93b2cdeb4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.247744] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.247744] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.247744] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.247744] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.247744] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.247744] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.247744] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.247744] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.247744] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.247744] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.247744] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0999f45-c89f-488f-b038-36a93b2cdeb4 is going to be updated. [ 706.297029] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.297029] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.297029] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.297029] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.297029] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.309859] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0999f45-c89f-488f-b038-36a93b2cdeb4 in Status: IN_PROGRESS for 2s [ 706.829196] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-325 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.830937] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-325" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.831107] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-325" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.831393] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-325" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.831704] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.831844] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.831964] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.832745] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.832888] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.833125] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 706.833252] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 706.834241] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 706.834241] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 706.834241] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 706.834241] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 706.834241] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 706.857263] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 706.857448] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 706.857589] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 706.857769] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-325" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.858101] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-17db7320-aeda-4613-b6e5-2a7660bd810f taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.858322] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-17db7320-aeda-4613-b6e5-2a7660bd810f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.858487] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-17db7320-aeda-4613-b6e5-2a7660bd810f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.858849] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-17db7320-aeda-4613-b6e5-2a7660bd810f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.859008] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('17db7320-aeda-4613-b6e5-2a7660bd810f',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.119614] env[70392]: INFO networking_nsxv3.common.synchronization [req-97b78261-9058-4ec4-b26c-7cb8f3f3bde7 req-cf482566-7139-4c25-9db1-1e0b8cebf465 service nova] Enqueued Resource ID: 440b9e9c-7b34-46fd-9988-db4bdb111a55 with Priority: HIGHEST for action security_group_rules [ 707.120698] env[70392]: INFO networking_nsxv3.common.synchronization [req-97b78261-9058-4ec4-b26c-7cb8f3f3bde7 req-cf482566-7139-4c25-9db1-1e0b8cebf465 service nova] Enqueued Resource ID: 440b9e9c-7b34-46fd-9988-db4bdb111a55 with Priority: HIGHEST for action security_group_members [ 707.121215] env[70392]: INFO networking_nsxv3.common.synchronization [req-97b78261-9058-4ec4-b26c-7cb8f3f3bde7 req-cf482566-7139-4c25-9db1-1e0b8cebf465 service nova] Enqueued Resource ID: 270159ed-9fd0-4347-b03f-33b46c6194f1 with Priority: HIGHEST for action port [ 707.122149] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 440b9e9c-7b34-46fd-9988-db4bdb111a55 with Priority: HIGHEST for action security_group_rules [ 707.122405] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 440b9e9c-7b34-46fd-9988-db4bdb111a55 with Priority: HIGHEST for action security_group_members [ 707.122776] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 270159ed-9fd0-4347-b03f-33b46c6194f1 with Priority: HIGHEST for action port [ 707.124691] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-440b9e9c-7b34-46fd-9988-db4bdb111a55 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.124691] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-440b9e9c-7b34-46fd-9988-db4bdb111a55" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.124691] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-440b9e9c-7b34-46fd-9988-db4bdb111a55" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.124691] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-440b9e9c-7b34-46fd-9988-db4bdb111a55" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.124691] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('440b9e9c-7b34-46fd-9988-db4bdb111a55',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.126573] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-440b9e9c-7b34-46fd-9988-db4bdb111a55 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.127082] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-440b9e9c-7b34-46fd-9988-db4bdb111a55" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.129681] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-440b9e9c-7b34-46fd-9988-db4bdb111a55" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.129681] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-440b9e9c-7b34-46fd-9988-db4bdb111a55" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.129681] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.129681] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.129681] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.129681] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.129681] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.129681] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('440b9e9c-7b34-46fd-9988-db4bdb111a55',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.132892] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-270159ed-9fd0-4347-b03f-33b46c6194f1 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.133296] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-270159ed-9fd0-4347-b03f-33b46c6194f1" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.133296] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-270159ed-9fd0-4347-b03f-33b46c6194f1" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.133449] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-270159ed-9fd0-4347-b03f-33b46c6194f1" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.133449] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('270159ed-9fd0-4347-b03f-33b46c6194f1',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.200013] env[70392]: INFO networking_nsxv3.common.synchronization [req-0c86698e-84f6-45bc-8dcc-0f5d621c1c89 req-491b109e-d4ce-4867-85d4-3819d080b9e4 tempest-FloatingIPsAssociationTestJSON-516556258 tempest-FloatingIPsAssociationTestJSON-516556258-project-member] Enqueued Resource ID: 87729ccf-b5c1-4c71-b616-13269541067e with Priority: HIGHEST for action security_group_members [ 707.204099] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87729ccf-b5c1-4c71-b616-13269541067e with Priority: HIGHEST for action security_group_members [ 707.204706] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-87729ccf-b5c1-4c71-b616-13269541067e taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.204845] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87729ccf-b5c1-4c71-b616-13269541067e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.204953] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87729ccf-b5c1-4c71-b616-13269541067e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.205346] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87729ccf-b5c1-4c71-b616-13269541067e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.205606] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.205729] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.206357] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.206357] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.206357] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.206529] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('87729ccf-b5c1-4c71-b616-13269541067e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.367705] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.368087] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.368327] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.368675] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.368909] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.369135] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 17db7320-aeda-4613-b6e5-2a7660bd810f not found, creating... [ 707.369504] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.369770] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.369914] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.370426] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.370632] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.371031] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.371247] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.371404] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.371830] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.372062] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.372257] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 17db7320-aeda-4613-b6e5-2a7660bd810f is going to be created. [ 707.396593] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.396822] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.397187] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.397404] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.397666] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.397955] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-17db7320-aeda-4613-b6e5-2a7660bd810f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.559955] env[70392]: INFO networking_nsxv3.common.synchronization [None req-10f78fe8-e5e6-4551-9faf-69cb450e70ae None None] Enqueued Resource ID: aa5ca631-b845-4e4d-9386-13bdffbdb340 with Priority: HIGHEST for action port [ 707.559955] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa5ca631-b845-4e4d-9386-13bdffbdb340 with Priority: HIGHEST for action port [ 707.559955] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa5ca631-b845-4e4d-9386-13bdffbdb340 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.559955] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa5ca631-b845-4e4d-9386-13bdffbdb340" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.559955] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa5ca631-b845-4e4d-9386-13bdffbdb340" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.559955] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa5ca631-b845-4e4d-9386-13bdffbdb340" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.559955] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa5ca631-b845-4e4d-9386-13bdffbdb340',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.635488] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-440b9e9c-7b34-46fd-9988-db4bdb111a55 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.635488] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-440b9e9c-7b34-46fd-9988-db4bdb111a55" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.638188] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 270159ed-9fd0-4347-b03f-33b46c6194f1 with status ACTIVE [ 707.638188] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.638188] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.638188] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.638188] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.638188] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.638188] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.638188] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.638188] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.638188] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.638188] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.640094] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.643244] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.643244] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.643244] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.643244] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.643244] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 270159ed-9fd0-4347-b03f-33b46c6194f1 is going to be updated. [ 707.643244] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('440b9e9c-7b34-46fd-9988-db4bdb111a55',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.666439] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.666439] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.666439] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.666439] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.666665] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.666718] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-270159ed-9fd0-4347-b03f-33b46c6194f1" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.709796] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.709994] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.710104] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.711051] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.711051] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.711051] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.711051] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.711051] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.711051] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.711051] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.711051] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 87729ccf-b5c1-4c71-b616-13269541067e already deleted. [ 707.711406] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87729ccf-b5c1-4c71-b616-13269541067e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.064910] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aa5ca631-b845-4e4d-9386-13bdffbdb340 [ 708.065343] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.065343] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.065495] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.066281] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.066281] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.066281] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aa5ca631-b845-4e4d-9386-13bdffbdb340 already deleted. [ 708.066281] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa5ca631-b845-4e4d-9386-13bdffbdb340" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.145804] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('440b9e9c-7b34-46fd-9988-db4bdb111a55',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.324123] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0999f45-c89f-488f-b038-36a93b2cdeb4 in Status: SUCCESS [ 708.324688] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0999f45-c89f-488f-b038-36a93b2cdeb4 deletion is rescheduled due to dependency. [ 708.324688] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0999f45-c89f-488f-b038-36a93b2cdeb4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.364616] env[70392]: INFO networking_nsxv3.common.synchronization [None req-9a7ec0af-04b1-4dd8-8c18-b9bf6b33dafa None None] Enqueued Resource ID: 6eeec20a-2de6-4d5c-938c-e0245bb91f23 with Priority: HIGHEST for action port [ 708.364616] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6eeec20a-2de6-4d5c-938c-e0245bb91f23 with Priority: HIGHEST for action port [ 708.364710] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-6eeec20a-2de6-4d5c-938c-e0245bb91f23 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.365089] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6eeec20a-2de6-4d5c-938c-e0245bb91f23" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.365203] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6eeec20a-2de6-4d5c-938c-e0245bb91f23" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.365462] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6eeec20a-2de6-4d5c-938c-e0245bb91f23" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.365560] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6eeec20a-2de6-4d5c-938c-e0245bb91f23',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.654062] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.654316] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.654388] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.654678] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.654823] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.654982] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 440b9e9c-7b34-46fd-9988-db4bdb111a55 is going to be created. [ 708.685634] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.685802] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.685861] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.686407] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.686407] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.698697] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 440b9e9c-7b34-46fd-9988-db4bdb111a55 in Status: UNINITIALIZED for 2s [ 708.826620] env[70392]: INFO networking_nsxv3.common.synchronization [None req-a593b0b2-3f53-4bc8-95c2-575ddeadb063 None None] Enqueued Resource ID: a8eea1c3-caf8-4566-b4c0-01c8ff89f9ab with Priority: HIGHEST for action port [ 708.830480] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8eea1c3-caf8-4566-b4c0-01c8ff89f9ab with Priority: HIGHEST for action port [ 708.830480] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-a8eea1c3-caf8-4566-b4c0-01c8ff89f9ab taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.830480] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a8eea1c3-caf8-4566-b4c0-01c8ff89f9ab" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.830480] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a8eea1c3-caf8-4566-b4c0-01c8ff89f9ab" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.830480] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a8eea1c3-caf8-4566-b4c0-01c8ff89f9ab" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.830480] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8eea1c3-caf8-4566-b4c0-01c8ff89f9ab',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.869335] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6eeec20a-2de6-4d5c-938c-e0245bb91f23 [ 708.869335] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.869335] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.869335] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.869335] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.869335] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.869335] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6eeec20a-2de6-4d5c-938c-e0245bb91f23 already deleted. [ 708.869335] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6eeec20a-2de6-4d5c-938c-e0245bb91f23" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.186277] env[70392]: INFO networking_nsxv3.common.synchronization [req-d4dbfac2-b8d9-4597-8e52-17b089a1e8cc req-ef12798c-7251-492d-a23a-159802c1628a service nova] Enqueued Resource ID: 5fec7002-3137-40f1-a653-f520126396a2 with Priority: HIGHEST for action security_group_rules [ 709.186615] env[70392]: INFO networking_nsxv3.common.synchronization [req-d4dbfac2-b8d9-4597-8e52-17b089a1e8cc req-ef12798c-7251-492d-a23a-159802c1628a service nova] Enqueued Resource ID: 5fec7002-3137-40f1-a653-f520126396a2 with Priority: HIGHEST for action security_group_members [ 709.186615] env[70392]: INFO networking_nsxv3.common.synchronization [req-d4dbfac2-b8d9-4597-8e52-17b089a1e8cc req-ef12798c-7251-492d-a23a-159802c1628a service nova] Enqueued Resource ID: 17db7320-aeda-4613-b6e5-2a7660bd810f with Priority: HIGHEST for action port [ 709.187178] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fec7002-3137-40f1-a653-f520126396a2 with Priority: HIGHEST for action security_group_rules [ 709.187385] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fec7002-3137-40f1-a653-f520126396a2 with Priority: HIGHEST for action security_group_members [ 709.187466] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17db7320-aeda-4613-b6e5-2a7660bd810f with Priority: HIGHEST for action port [ 709.187840] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5fec7002-3137-40f1-a653-f520126396a2 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.188049] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.188135] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.188424] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.188515] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5fec7002-3137-40f1-a653-f520126396a2',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.189389] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fec7002-3137-40f1-a653-f520126396a2 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.189491] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.189557] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.189727] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.189872] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.189964] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.190268] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.190441] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.190576] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.190704] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5fec7002-3137-40f1-a653-f520126396a2',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.191618] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-17db7320-aeda-4613-b6e5-2a7660bd810f taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.191727] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-17db7320-aeda-4613-b6e5-2a7660bd810f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.191795] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-17db7320-aeda-4613-b6e5-2a7660bd810f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.191946] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-17db7320-aeda-4613-b6e5-2a7660bd810f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.192176] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('17db7320-aeda-4613-b6e5-2a7660bd810f',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.333978] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a8eea1c3-caf8-4566-b4c0-01c8ff89f9ab [ 709.334355] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.334622] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.334686] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.335014] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.335412] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.335412] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a8eea1c3-caf8-4566-b4c0-01c8ff89f9ab already deleted. [ 709.335595] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a8eea1c3-caf8-4566-b4c0-01c8ff89f9ab" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.505102] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-517 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.505425] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-517" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.505549] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-517" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.505866] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-517" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.506155] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.506314] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.506433] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.506748] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.506965] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.507633] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 709.507773] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 709.507848] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 709.507966] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 709.508090] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 709.508252] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 709.508472] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 709.541103] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 709.541282] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 709.541423] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 709.541623] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-517" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.541965] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-ecf21da9-6dd9-4a10-b956-149bc7de2f88 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.542162] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-ecf21da9-6dd9-4a10-b956-149bc7de2f88" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.542288] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-ecf21da9-6dd9-4a10-b956-149bc7de2f88" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.542691] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-ecf21da9-6dd9-4a10-b956-149bc7de2f88" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.543204] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ecf21da9-6dd9-4a10-b956-149bc7de2f88',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.694202] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fec7002-3137-40f1-a653-f520126396a2 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.694387] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.694595] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5fec7002-3137-40f1-a653-f520126396a2',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.695738] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 17db7320-aeda-4613-b6e5-2a7660bd810f with status ACTIVE [ 709.698852] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.698852] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.698852] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.698852] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.698852] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.698852] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.698852] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.698852] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.698852] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.698852] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.698852] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.698852] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.698852] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.698852] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.698852] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.698852] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 17db7320-aeda-4613-b6e5-2a7660bd810f is going to be updated. [ 709.729572] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.729835] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.729835] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.730075] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.730999] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.730999] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-17db7320-aeda-4613-b6e5-2a7660bd810f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.049023] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.049023] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.049023] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.049023] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.049023] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.049023] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port ecf21da9-6dd9-4a10-b956-149bc7de2f88 not found, creating... [ 710.049023] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.049023] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.049023] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.049023] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.049023] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.049723] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.050627] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.050945] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.051319] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.051601] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.051896] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: ecf21da9-6dd9-4a10-b956-149bc7de2f88 is going to be created. [ 710.076863] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.076863] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.076863] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.076863] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.076863] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.076863] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-ecf21da9-6dd9-4a10-b956-149bc7de2f88" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.201926] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5fec7002-3137-40f1-a653-f520126396a2',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.704495] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.705331] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.705331] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.706647] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.706647] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.706791] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5fec7002-3137-40f1-a653-f520126396a2 is going to be created. [ 710.709928] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 440b9e9c-7b34-46fd-9988-db4bdb111a55 in Status: SUCCESS [ 710.709928] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-440b9e9c-7b34-46fd-9988-db4bdb111a55" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.709928] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-440b9e9c-7b34-46fd-9988-db4bdb111a55" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.711340] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-440b9e9c-7b34-46fd-9988-db4bdb111a55" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.711547] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.711779] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.711873] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.712043] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.712136] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.712298] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-440b9e9c-7b34-46fd-9988-db4bdb111a55" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.712353] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('440b9e9c-7b34-46fd-9988-db4bdb111a55',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.732788] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.732939] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.733021] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.733240] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.733510] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.746412] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5fec7002-3137-40f1-a653-f520126396a2 in Status: UNINITIALIZED for 2s [ 711.055416] env[70392]: INFO networking_nsxv3.common.synchronization [req-d8b65013-4508-417c-8fe9-7383e3b10e40 req-ac323830-1221-4332-b3f4-582d69ca591a tempest-VolumesAssistedSnapshotsTest-1612074774 tempest-VolumesAssistedSnapshotsTest-1612074774-project-member] Enqueued Resource ID: 247680ec-824d-41ac-8735-1edb7b119a99 with Priority: HIGHEST for action security_group_members [ 711.056185] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 247680ec-824d-41ac-8735-1edb7b119a99 with Priority: HIGHEST for action security_group_members [ 711.056291] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-247680ec-824d-41ac-8735-1edb7b119a99 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.056415] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-247680ec-824d-41ac-8735-1edb7b119a99" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.056484] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-247680ec-824d-41ac-8735-1edb7b119a99" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.056738] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-247680ec-824d-41ac-8735-1edb7b119a99" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.056899] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.056998] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.060562] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.060562] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.060562] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.060879] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('247680ec-824d-41ac-8735-1edb7b119a99',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.064504] env[70392]: INFO networking_nsxv3.common.synchronization [None req-30c0e869-9cb9-42ed-9403-9295c8d2ed86 None None] Enqueued Resource ID: c9b46aeb-3e12-4efa-9a1e-7a05dadbcfae with Priority: HIGHEST for action port [ 711.065227] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9b46aeb-3e12-4efa-9a1e-7a05dadbcfae with Priority: HIGHEST for action port [ 711.065785] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-c9b46aeb-3e12-4efa-9a1e-7a05dadbcfae taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.065785] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c9b46aeb-3e12-4efa-9a1e-7a05dadbcfae" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.065984] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c9b46aeb-3e12-4efa-9a1e-7a05dadbcfae" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.066299] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c9b46aeb-3e12-4efa-9a1e-7a05dadbcfae" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.066385] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9b46aeb-3e12-4efa-9a1e-7a05dadbcfae',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.217877] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-440b9e9c-7b34-46fd-9988-db4bdb111a55 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.218174] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-440b9e9c-7b34-46fd-9988-db4bdb111a55" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.218174] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-440b9e9c-7b34-46fd-9988-db4bdb111a55" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.218310] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-440b9e9c-7b34-46fd-9988-db4bdb111a55" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.218567] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.218678] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.218728] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.218894] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.218985] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.219090] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-440b9e9c-7b34-46fd-9988-db4bdb111a55" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.219240] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-440b9e9c-7b34-46fd-9988-db4bdb111a55 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.219336] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-440b9e9c-7b34-46fd-9988-db4bdb111a55" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.219395] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-440b9e9c-7b34-46fd-9988-db4bdb111a55" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.219541] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-440b9e9c-7b34-46fd-9988-db4bdb111a55" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.219762] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.219858] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.219917] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.220072] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.220152] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.220237] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-440b9e9c-7b34-46fd-9988-db4bdb111a55" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.220326] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('440b9e9c-7b34-46fd-9988-db4bdb111a55',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.565923] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.566230] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.567147] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.567517] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.567623] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.567868] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.567929] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.567980] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.568303] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.568303] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.568508] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 247680ec-824d-41ac-8735-1edb7b119a99 already deleted. [ 711.568595] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-247680ec-824d-41ac-8735-1edb7b119a99" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.569193] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c9b46aeb-3e12-4efa-9a1e-7a05dadbcfae [ 711.569340] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.569496] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.569496] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.569869] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.569965] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.570060] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c9b46aeb-3e12-4efa-9a1e-7a05dadbcfae already deleted. [ 711.570141] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c9b46aeb-3e12-4efa-9a1e-7a05dadbcfae" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.728631] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 440b9e9c-7b34-46fd-9988-db4bdb111a55: rpc.has_security_group_logging(os_id): False [ 711.755657] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.755657] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.755657] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.755917] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.755917] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.756107] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.756317] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.756398] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.756510] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.756590] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.756833] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.756913] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.757107] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.757174] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.759177] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.759177] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.759177] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.759177] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.759177] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.759177] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.759815] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 440b9e9c-7b34-46fd-9988-db4bdb111a55 is going to be created. [ 711.829670] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.829873] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.829873] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.830259] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.830348] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.847696] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 440b9e9c-7b34-46fd-9988-db4bdb111a55 in Status: IN_PROGRESS for 2s [ 712.076252] env[70392]: INFO networking_nsxv3.common.synchronization [req-0c86698e-84f6-45bc-8dcc-0f5d621c1c89 req-c37f3ec1-c289-4000-bee5-748d08180f2c service nova] Enqueued Resource ID: 87729ccf-b5c1-4c71-b616-13269541067e with Priority: HIGHEST for action security_group_rules [ 712.076745] env[70392]: INFO networking_nsxv3.common.synchronization [req-0c86698e-84f6-45bc-8dcc-0f5d621c1c89 req-c37f3ec1-c289-4000-bee5-748d08180f2c service nova] Enqueued Resource ID: 87729ccf-b5c1-4c71-b616-13269541067e with Priority: HIGHEST for action security_group_members [ 712.077139] env[70392]: INFO networking_nsxv3.common.synchronization [req-0c86698e-84f6-45bc-8dcc-0f5d621c1c89 req-c37f3ec1-c289-4000-bee5-748d08180f2c service nova] Enqueued Resource ID: ecf21da9-6dd9-4a10-b956-149bc7de2f88 with Priority: HIGHEST for action port [ 712.079633] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87729ccf-b5c1-4c71-b616-13269541067e with Priority: HIGHEST for action security_group_rules [ 712.079633] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87729ccf-b5c1-4c71-b616-13269541067e with Priority: HIGHEST for action security_group_members [ 712.079633] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ecf21da9-6dd9-4a10-b956-149bc7de2f88 with Priority: HIGHEST for action port [ 712.079633] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-87729ccf-b5c1-4c71-b616-13269541067e taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.079633] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-87729ccf-b5c1-4c71-b616-13269541067e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.079633] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-87729ccf-b5c1-4c71-b616-13269541067e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.081941] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-87729ccf-b5c1-4c71-b616-13269541067e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.081941] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('87729ccf-b5c1-4c71-b616-13269541067e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.081941] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-87729ccf-b5c1-4c71-b616-13269541067e taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.081941] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87729ccf-b5c1-4c71-b616-13269541067e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.083890] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87729ccf-b5c1-4c71-b616-13269541067e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.085182] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87729ccf-b5c1-4c71-b616-13269541067e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.085182] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.085182] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.085182] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.085182] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.085182] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.085182] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('87729ccf-b5c1-4c71-b616-13269541067e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.088790] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-ecf21da9-6dd9-4a10-b956-149bc7de2f88 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.088790] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ecf21da9-6dd9-4a10-b956-149bc7de2f88" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.088790] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ecf21da9-6dd9-4a10-b956-149bc7de2f88" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.088928] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ecf21da9-6dd9-4a10-b956-149bc7de2f88" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.088928] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ecf21da9-6dd9-4a10-b956-149bc7de2f88',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.525410] env[70392]: INFO networking_nsxv3.common.synchronization [None req-3cd8d25c-eb30-439b-a6ea-721feb1e6284 None None] Enqueued Resource ID: e067f41d-758d-46f7-abbf-e165f4a46e6c with Priority: HIGHEST for action port [ 712.526178] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e067f41d-758d-46f7-abbf-e165f4a46e6c with Priority: HIGHEST for action port [ 712.526829] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-e067f41d-758d-46f7-abbf-e165f4a46e6c taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.526829] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e067f41d-758d-46f7-abbf-e165f4a46e6c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.526829] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e067f41d-758d-46f7-abbf-e165f4a46e6c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.527041] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e067f41d-758d-46f7-abbf-e165f4a46e6c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.527041] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e067f41d-758d-46f7-abbf-e165f4a46e6c',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.591236] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('87729ccf-b5c1-4c71-b616-13269541067e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.592263] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-87729ccf-b5c1-4c71-b616-13269541067e taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.592414] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87729ccf-b5c1-4c71-b616-13269541067e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.594406] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ecf21da9-6dd9-4a10-b956-149bc7de2f88 with status ACTIVE [ 712.594406] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.594564] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.594645] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.594798] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.594895] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.599865] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.599865] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.599865] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.599865] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.599865] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.599865] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.599865] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.599865] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.599865] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.599865] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.599865] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ecf21da9-6dd9-4a10-b956-149bc7de2f88 is going to be updated. [ 712.622106] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.622440] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.622440] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.622440] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.622690] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.622743] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ecf21da9-6dd9-4a10-b956-149bc7de2f88" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.759428] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5fec7002-3137-40f1-a653-f520126396a2 in Status: SUCCESS [ 712.759739] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.759925] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.760130] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.760392] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.760392] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.760529] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.760640] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.760674] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.760751] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.760834] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5fec7002-3137-40f1-a653-f520126396a2',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.773376] env[70392]: INFO networking_nsxv3.common.synchronization [req-8d3f9c66-28ab-45eb-a8ca-73ef60d315fd req-dafb17ef-cd37-4ec7-95bc-2af621688f3a tempest-InstanceActionsV221TestJSON-1001043171 tempest-InstanceActionsV221TestJSON-1001043171-project-member] Enqueued Resource ID: 8672d193-ffc9-46be-83d4-064399b66865 with Priority: HIGHEST for action security_group_members [ 712.773376] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8672d193-ffc9-46be-83d4-064399b66865 with Priority: HIGHEST for action security_group_members [ 712.773376] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-8672d193-ffc9-46be-83d4-064399b66865 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.773376] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8672d193-ffc9-46be-83d4-064399b66865" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.773376] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8672d193-ffc9-46be-83d4-064399b66865" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.773376] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8672d193-ffc9-46be-83d4-064399b66865" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.773376] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.773376] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.774778] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.775689] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.776319] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.776517] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8672d193-ffc9-46be-83d4-064399b66865',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.895487] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-89 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.895691] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-89" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.895846] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-89" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.898421] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-89" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.898421] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.898421] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.898421] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.898921] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.898921] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.899197] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 712.899275] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 712.899357] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 712.899477] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 712.899624] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 712.899747] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 712.899874] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 712.903848] env[70392]: INFO networking_nsxv3.common.synchronization [None req-5d460293-5d29-4855-be26-569a4752e487 None None] Enqueued Resource ID: a7a39e0e-8675-407d-8446-81981130efcb with Priority: HIGHEST for action port [ 712.905652] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7a39e0e-8675-407d-8446-81981130efcb with Priority: HIGHEST for action port [ 712.906393] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-a7a39e0e-8675-407d-8446-81981130efcb taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.906605] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a7a39e0e-8675-407d-8446-81981130efcb" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.906605] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a7a39e0e-8675-407d-8446-81981130efcb" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.907089] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a7a39e0e-8675-407d-8446-81981130efcb" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.907089] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7a39e0e-8675-407d-8446-81981130efcb',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.937855] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 712.938934] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.038 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 712.939684] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 712.940104] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-89" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.940920] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-f3bde114-3afc-44d9-b700-031059700635 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.942035] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-f3bde114-3afc-44d9-b700-031059700635" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.942489] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-f3bde114-3afc-44d9-b700-031059700635" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.943184] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-f3bde114-3afc-44d9-b700-031059700635" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.945024] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3bde114-3afc-44d9-b700-031059700635',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.029236] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e067f41d-758d-46f7-abbf-e165f4a46e6c [ 713.029497] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.029643] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.029713] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.029983] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.030183] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.030590] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e067f41d-758d-46f7-abbf-e165f4a46e6c already deleted. [ 713.030590] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e067f41d-758d-46f7-abbf-e165f4a46e6c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.095656] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('87729ccf-b5c1-4c71-b616-13269541067e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.174102] env[70392]: INFO networking_nsxv3.common.synchronization [None req-3aeab224-d1a0-43ab-bfb8-e983036d355a None None] Enqueued Resource ID: ab8b6358-120b-4adf-adce-e697846ad57d with Priority: HIGHEST for action port [ 713.174102] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab8b6358-120b-4adf-adce-e697846ad57d with Priority: HIGHEST for action port [ 713.178594] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-ab8b6358-120b-4adf-adce-e697846ad57d taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.178788] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ab8b6358-120b-4adf-adce-e697846ad57d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.178853] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ab8b6358-120b-4adf-adce-e697846ad57d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.179150] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ab8b6358-120b-4adf-adce-e697846ad57d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.179552] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab8b6358-120b-4adf-adce-e697846ad57d',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.266101] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fec7002-3137-40f1-a653-f520126396a2 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.266345] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.266345] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.266497] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.266700] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.267068] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.267147] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.267578] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.267578] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.267578] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.267761] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fec7002-3137-40f1-a653-f520126396a2 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.267847] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.267900] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.269115] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.269556] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.269556] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.269556] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.269792] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.269917] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.269995] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.270068] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5fec7002-3137-40f1-a653-f520126396a2',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.281371] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.281859] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.281859] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.281960] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.282082] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.282257] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.282381] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.282436] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.282618] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.282701] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.282793] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8672d193-ffc9-46be-83d4-064399b66865 already deleted. [ 713.282877] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8672d193-ffc9-46be-83d4-064399b66865" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.410432] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a7a39e0e-8675-407d-8446-81981130efcb [ 713.410979] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.411392] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.411620] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.412456] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.413117] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.413117] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a7a39e0e-8675-407d-8446-81981130efcb already deleted. [ 713.413117] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a7a39e0e-8675-407d-8446-81981130efcb" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.448374] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.448748] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.448956] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.449479] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.450204] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.450204] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port f3bde114-3afc-44d9-b700-031059700635 not found, creating... [ 713.450204] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.450405] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.450443] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.450738] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.450958] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.451293] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.451463] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.451579] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.452264] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.452264] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.452264] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: f3bde114-3afc-44d9-b700-031059700635 is going to be created. [ 713.481226] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.481599] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.481889] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.482168] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.482487] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.482811] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-f3bde114-3afc-44d9-b700-031059700635" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.512370] env[70392]: INFO networking_nsxv3.common.synchronization [None req-c8716c64-8652-4263-9b3e-f7b7579b4e1b None None] Enqueued Resource ID: 2951220f-fcd4-4c3e-82eb-d39ae8486885 with Priority: HIGHEST for action port [ 713.512370] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2951220f-fcd4-4c3e-82eb-d39ae8486885 with Priority: HIGHEST for action port [ 713.513023] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-2951220f-fcd4-4c3e-82eb-d39ae8486885 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.513184] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2951220f-fcd4-4c3e-82eb-d39ae8486885" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.513257] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2951220f-fcd4-4c3e-82eb-d39ae8486885" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.513535] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2951220f-fcd4-4c3e-82eb-d39ae8486885" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.513589] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2951220f-fcd4-4c3e-82eb-d39ae8486885',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.601976] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.602248] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.602248] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.602741] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.602741] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.602741] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 87729ccf-b5c1-4c71-b616-13269541067e is going to be created. [ 713.632848] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.632848] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.632848] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.633358] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.633358] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.644629] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87729ccf-b5c1-4c71-b616-13269541067e in Status: UNINITIALIZED for 2s [ 713.683920] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ab8b6358-120b-4adf-adce-e697846ad57d [ 713.684969] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.685183] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.685183] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.685491] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.686089] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.686240] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ab8b6358-120b-4adf-adce-e697846ad57d already deleted. [ 713.686347] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ab8b6358-120b-4adf-adce-e697846ad57d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.776617] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5fec7002-3137-40f1-a653-f520126396a2: rpc.has_security_group_logging(os_id): False [ 713.797485] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.797485] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.797485] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.797485] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.797485] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.797485] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.797485] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.797485] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.797784] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.797784] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.797893] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.797950] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.798020] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.798438] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.798514] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.798726] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.798817] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.798879] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.799035] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.799107] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.799190] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5fec7002-3137-40f1-a653-f520126396a2 is going to be created. [ 713.864059] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 440b9e9c-7b34-46fd-9988-db4bdb111a55 in Status: SUCCESS [ 713.864372] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-440b9e9c-7b34-46fd-9988-db4bdb111a55" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.875546] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.875546] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.875546] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.875546] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.875546] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.892062] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5fec7002-3137-40f1-a653-f520126396a2 in Status: IN_PROGRESS for 2s [ 713.997159] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-680 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.997159] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-680" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.997159] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-680" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.997159] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-680" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.997159] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.997159] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.002867] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.002867] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.002867] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.002867] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 714.002867] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 714.002867] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 714.002867] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 714.002867] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 714.002867] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 714.002867] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 714.016410] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2951220f-fcd4-4c3e-82eb-d39ae8486885 [ 714.019095] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.019095] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.019095] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.019095] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.019095] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.019422] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2951220f-fcd4-4c3e-82eb-d39ae8486885 already deleted. [ 714.019422] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2951220f-fcd4-4c3e-82eb-d39ae8486885" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.037968] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 714.037968] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 714.037968] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 714.037968] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-680" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.037968] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-13e7208e-9aea-49f5-a81f-05de005dbcb0 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.037968] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-13e7208e-9aea-49f5-a81f-05de005dbcb0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.037968] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-13e7208e-9aea-49f5-a81f-05de005dbcb0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.037968] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-13e7208e-9aea-49f5-a81f-05de005dbcb0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.037968] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('13e7208e-9aea-49f5-a81f-05de005dbcb0',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.546388] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.546621] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.549024] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.549024] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.549024] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.549024] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 13e7208e-9aea-49f5-a81f-05de005dbcb0 not found, creating... [ 714.549024] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.549024] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.549024] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.549024] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.549024] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.549024] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.549661] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.549802] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.550174] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.550367] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.550753] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 13e7208e-9aea-49f5-a81f-05de005dbcb0 is going to be created. [ 714.571856] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.572653] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.572916] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.573251] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.573459] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.573792] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-13e7208e-9aea-49f5-a81f-05de005dbcb0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.116995] env[70392]: INFO networking_nsxv3.common.synchronization [None req-ab37f1a7-7f6c-467d-9217-00f8fe81599c tempest-ServerActionsV293TestJSON-2036472382 tempest-ServerActionsV293TestJSON-2036472382-project-member] Enqueued Resource ID: 44698b7f-7125-46d0-837f-5d44d3ee1aea with Priority: HIGHEST for action security_group_rules [ 715.117553] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44698b7f-7125-46d0-837f-5d44d3ee1aea with Priority: HIGHEST for action security_group_rules [ 715.117861] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-44698b7f-7125-46d0-837f-5d44d3ee1aea taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.118033] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-44698b7f-7125-46d0-837f-5d44d3ee1aea" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.118362] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-44698b7f-7125-46d0-837f-5d44d3ee1aea" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.118649] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-44698b7f-7125-46d0-837f-5d44d3ee1aea" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.118785] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('44698b7f-7125-46d0-837f-5d44d3ee1aea',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.183029] env[70392]: INFO networking_nsxv3.common.synchronization [None req-0b4b5e67-8a85-4950-9739-648e022e96b7 None None] Enqueued Resource ID: 000eaefb-40fc-436a-8c7f-a79aa9ac7ee2 with Priority: HIGHEST for action port [ 715.183645] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 000eaefb-40fc-436a-8c7f-a79aa9ac7ee2 with Priority: HIGHEST for action port [ 715.184351] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-000eaefb-40fc-436a-8c7f-a79aa9ac7ee2 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.184741] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-000eaefb-40fc-436a-8c7f-a79aa9ac7ee2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.185071] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-000eaefb-40fc-436a-8c7f-a79aa9ac7ee2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.185567] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-000eaefb-40fc-436a-8c7f-a79aa9ac7ee2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.185781] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('000eaefb-40fc-436a-8c7f-a79aa9ac7ee2',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.246761] env[70392]: INFO networking_nsxv3.common.synchronization [None req-56290a1c-1fd9-4b11-95ec-e57e280bc343 tempest-AttachVolumeTestJSON-1272662447 tempest-AttachVolumeTestJSON-1272662447-project-member] Enqueued Resource ID: ac589e4e-a2e5-4716-8490-eecefc1b6a5e with Priority: HIGHEST for action security_group_rules [ 715.247857] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac589e4e-a2e5-4716-8490-eecefc1b6a5e with Priority: HIGHEST for action security_group_rules [ 715.248812] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac589e4e-a2e5-4716-8490-eecefc1b6a5e taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.249476] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac589e4e-a2e5-4716-8490-eecefc1b6a5e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.249599] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac589e4e-a2e5-4716-8490-eecefc1b6a5e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.250259] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac589e4e-a2e5-4716-8490-eecefc1b6a5e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.250382] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac589e4e-a2e5-4716-8490-eecefc1b6a5e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.357043] env[70392]: INFO networking_nsxv3.common.synchronization [None req-fe03da13-b6bc-4809-8e72-336dab2e3e5d None None] Enqueued Resource ID: 681fc427-657e-4f8e-8eb8-d243aff9d7ba with Priority: HIGHEST for action port [ 715.357345] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 681fc427-657e-4f8e-8eb8-d243aff9d7ba with Priority: HIGHEST for action port [ 715.358253] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-681fc427-657e-4f8e-8eb8-d243aff9d7ba taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.358435] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-681fc427-657e-4f8e-8eb8-d243aff9d7ba" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.358541] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-681fc427-657e-4f8e-8eb8-d243aff9d7ba" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.358918] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-681fc427-657e-4f8e-8eb8-d243aff9d7ba" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.359124] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('681fc427-657e-4f8e-8eb8-d243aff9d7ba',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.491473] env[70392]: INFO networking_nsxv3.common.synchronization [None req-c48f244e-1274-44ac-b4e6-48e14fb9ecfb tempest-ServerActionsV293TestJSON-2036472382 tempest-ServerActionsV293TestJSON-2036472382-project-member] Enqueued Resource ID: 44698b7f-7125-46d0-837f-5d44d3ee1aea with Priority: HIGHEST for action security_group_rules [ 715.494394] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44698b7f-7125-46d0-837f-5d44d3ee1aea with Priority: HIGHEST for action security_group_rules [ 715.496483] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-44698b7f-7125-46d0-837f-5d44d3ee1aea taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.497131] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-44698b7f-7125-46d0-837f-5d44d3ee1aea" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.643022] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.643022] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.643022] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.643022] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.643022] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.643022] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 44698b7f-7125-46d0-837f-5d44d3ee1aea already deleted. [ 715.643022] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-44698b7f-7125-46d0-837f-5d44d3ee1aea" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.643515] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-44698b7f-7125-46d0-837f-5d44d3ee1aea" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.643565] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-44698b7f-7125-46d0-837f-5d44d3ee1aea" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.643646] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('44698b7f-7125-46d0-837f-5d44d3ee1aea',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.656835] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87729ccf-b5c1-4c71-b616-13269541067e in Status: SUCCESS [ 715.656835] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87729ccf-b5c1-4c71-b616-13269541067e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.656835] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87729ccf-b5c1-4c71-b616-13269541067e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.657226] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87729ccf-b5c1-4c71-b616-13269541067e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.658123] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.658221] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.658298] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.658559] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.658656] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.658763] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87729ccf-b5c1-4c71-b616-13269541067e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.658897] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('87729ccf-b5c1-4c71-b616-13269541067e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.687743] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 000eaefb-40fc-436a-8c7f-a79aa9ac7ee2 [ 715.687986] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.688135] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.688242] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.688479] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.688581] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.688679] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:000eaefb-40fc-436a-8c7f-a79aa9ac7ee2 already deleted. [ 715.688762] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-000eaefb-40fc-436a-8c7f-a79aa9ac7ee2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.705398] env[70392]: INFO networking_nsxv3.common.synchronization [req-d8b65013-4508-417c-8fe9-7383e3b10e40 req-1bca87ba-fe8b-4940-8fc1-f7f297dfb64d service nova] Enqueued Resource ID: 247680ec-824d-41ac-8735-1edb7b119a99 with Priority: HIGHEST for action security_group_rules [ 715.705578] env[70392]: INFO networking_nsxv3.common.synchronization [req-d8b65013-4508-417c-8fe9-7383e3b10e40 req-1bca87ba-fe8b-4940-8fc1-f7f297dfb64d service nova] Enqueued Resource ID: 247680ec-824d-41ac-8735-1edb7b119a99 with Priority: HIGHEST for action security_group_members [ 715.705732] env[70392]: INFO networking_nsxv3.common.synchronization [req-d8b65013-4508-417c-8fe9-7383e3b10e40 req-1bca87ba-fe8b-4940-8fc1-f7f297dfb64d service nova] Enqueued Resource ID: f3bde114-3afc-44d9-b700-031059700635 with Priority: HIGHEST for action port [ 715.706243] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 247680ec-824d-41ac-8735-1edb7b119a99 with Priority: HIGHEST for action security_group_rules [ 715.706385] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 247680ec-824d-41ac-8735-1edb7b119a99 with Priority: HIGHEST for action security_group_members [ 715.706504] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3bde114-3afc-44d9-b700-031059700635 with Priority: HIGHEST for action port [ 715.707485] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-247680ec-824d-41ac-8735-1edb7b119a99 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.707638] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-247680ec-824d-41ac-8735-1edb7b119a99" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.707709] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-247680ec-824d-41ac-8735-1edb7b119a99" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.707913] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-247680ec-824d-41ac-8735-1edb7b119a99" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.708054] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('247680ec-824d-41ac-8735-1edb7b119a99',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.709622] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-247680ec-824d-41ac-8735-1edb7b119a99 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.709724] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-247680ec-824d-41ac-8735-1edb7b119a99" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.709768] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-247680ec-824d-41ac-8735-1edb7b119a99" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.709940] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-247680ec-824d-41ac-8735-1edb7b119a99" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.710141] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.710242] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.710303] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.710452] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.710539] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.710632] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('247680ec-824d-41ac-8735-1edb7b119a99',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.711401] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-f3bde114-3afc-44d9-b700-031059700635 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.711529] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f3bde114-3afc-44d9-b700-031059700635" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.711569] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f3bde114-3afc-44d9-b700-031059700635" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.711723] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f3bde114-3afc-44d9-b700-031059700635" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.711825] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3bde114-3afc-44d9-b700-031059700635',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.743238] env[70392]: INFO networking_nsxv3.common.synchronization [None req-3389d58b-2044-4b01-a0a8-e308d7f097b5 tempest-AttachVolumeTestJSON-1272662447 tempest-AttachVolumeTestJSON-1272662447-project-member] Enqueued Resource ID: ac589e4e-a2e5-4716-8490-eecefc1b6a5e with Priority: HIGHEST for action security_group_rules [ 715.744255] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac589e4e-a2e5-4716-8490-eecefc1b6a5e with Priority: HIGHEST for action security_group_rules [ 715.746501] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac589e4e-a2e5-4716-8490-eecefc1b6a5e taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.746501] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac589e4e-a2e5-4716-8490-eecefc1b6a5e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.775556] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.775748] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.776163] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.776163] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.776163] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.776351] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac589e4e-a2e5-4716-8490-eecefc1b6a5e already deleted. [ 715.776351] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac589e4e-a2e5-4716-8490-eecefc1b6a5e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.776876] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac589e4e-a2e5-4716-8490-eecefc1b6a5e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.777066] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac589e4e-a2e5-4716-8490-eecefc1b6a5e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.777156] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac589e4e-a2e5-4716-8490-eecefc1b6a5e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.864210] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 681fc427-657e-4f8e-8eb8-d243aff9d7ba [ 715.864405] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.864522] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.864594] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.864837] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.864962] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.865078] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:681fc427-657e-4f8e-8eb8-d243aff9d7ba already deleted. [ 715.865166] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-681fc427-657e-4f8e-8eb8-d243aff9d7ba" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.910758] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5fec7002-3137-40f1-a653-f520126396a2 in Status: SUCCESS [ 715.910758] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.005821] env[70392]: INFO networking_nsxv3.common.synchronization [req-ae90ac63-b841-4d28-9d8c-058c105e7615 req-0e57e0fd-de3f-42d5-b485-4a50d414aad3 tempest-ServersWithSpecificFlavorTestJSON-1944551370 tempest-ServersWithSpecificFlavorTestJSON-1944551370-project-member] Enqueued Resource ID: 7f78f149-d978-4089-8aa8-d480e7d7bb61 with Priority: HIGHEST for action security_group_members [ 716.010750] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f78f149-d978-4089-8aa8-d480e7d7bb61 with Priority: HIGHEST for action security_group_members [ 716.011640] env[70392]: INFO networking_nsxv3.common.synchronization [req-8d3f9c66-28ab-45eb-a8ca-73ef60d315fd req-f2111eb2-9174-4739-9322-198e71375fff service nova] Enqueued Resource ID: 8672d193-ffc9-46be-83d4-064399b66865 with Priority: HIGHEST for action security_group_rules [ 716.011887] env[70392]: INFO networking_nsxv3.common.synchronization [req-8d3f9c66-28ab-45eb-a8ca-73ef60d315fd req-f2111eb2-9174-4739-9322-198e71375fff service nova] Enqueued Resource ID: 8672d193-ffc9-46be-83d4-064399b66865 with Priority: HIGHEST for action security_group_members [ 716.011992] env[70392]: INFO networking_nsxv3.common.synchronization [req-8d3f9c66-28ab-45eb-a8ca-73ef60d315fd req-f2111eb2-9174-4739-9322-198e71375fff service nova] Enqueued Resource ID: 13e7208e-9aea-49f5-a81f-05de005dbcb0 with Priority: HIGHEST for action port [ 716.012402] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f78f149-d978-4089-8aa8-d480e7d7bb61 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.012563] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f78f149-d978-4089-8aa8-d480e7d7bb61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.012632] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f78f149-d978-4089-8aa8-d480e7d7bb61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.014114] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f78f149-d978-4089-8aa8-d480e7d7bb61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.014114] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.014114] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.014114] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.014114] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.014114] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.014114] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f78f149-d978-4089-8aa8-d480e7d7bb61',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.014957] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8672d193-ffc9-46be-83d4-064399b66865 with Priority: HIGHEST for action security_group_rules [ 716.014957] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8672d193-ffc9-46be-83d4-064399b66865 with Priority: HIGHEST for action security_group_members [ 716.014957] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13e7208e-9aea-49f5-a81f-05de005dbcb0 with Priority: HIGHEST for action port [ 716.016356] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8672d193-ffc9-46be-83d4-064399b66865 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.016356] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8672d193-ffc9-46be-83d4-064399b66865" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.016356] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8672d193-ffc9-46be-83d4-064399b66865" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.016356] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8672d193-ffc9-46be-83d4-064399b66865" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.016356] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8672d193-ffc9-46be-83d4-064399b66865',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.019713] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-8672d193-ffc9-46be-83d4-064399b66865 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.022788] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8672d193-ffc9-46be-83d4-064399b66865" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.022788] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8672d193-ffc9-46be-83d4-064399b66865" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.022788] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8672d193-ffc9-46be-83d4-064399b66865" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.022788] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.022788] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.023173] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.023173] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.023173] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.023291] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8672d193-ffc9-46be-83d4-064399b66865',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.024428] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-13e7208e-9aea-49f5-a81f-05de005dbcb0 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.024428] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-13e7208e-9aea-49f5-a81f-05de005dbcb0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.024428] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-13e7208e-9aea-49f5-a81f-05de005dbcb0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.024612] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-13e7208e-9aea-49f5-a81f-05de005dbcb0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.024749] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('13e7208e-9aea-49f5-a81f-05de005dbcb0',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.025627] env[70392]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 716.163325] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-87729ccf-b5c1-4c71-b616-13269541067e taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.163695] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87729ccf-b5c1-4c71-b616-13269541067e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.163695] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87729ccf-b5c1-4c71-b616-13269541067e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.164059] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87729ccf-b5c1-4c71-b616-13269541067e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.167243] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.167243] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.167454] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.167489] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.167590] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.167706] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87729ccf-b5c1-4c71-b616-13269541067e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.167874] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-87729ccf-b5c1-4c71-b616-13269541067e taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.167976] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87729ccf-b5c1-4c71-b616-13269541067e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.168065] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87729ccf-b5c1-4c71-b616-13269541067e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.168262] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87729ccf-b5c1-4c71-b616-13269541067e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.168468] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.169265] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.169265] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.169265] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.169265] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.169265] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87729ccf-b5c1-4c71-b616-13269541067e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.169265] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('87729ccf-b5c1-4c71-b616-13269541067e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.171122] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.171260] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.171357] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.172556] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.172556] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.172556] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 44698b7f-7125-46d0-837f-5d44d3ee1aea already deleted. [ 716.172556] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-44698b7f-7125-46d0-837f-5d44d3ee1aea" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.211054] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-247680ec-824d-41ac-8735-1edb7b119a99 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.212264] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-247680ec-824d-41ac-8735-1edb7b119a99" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.215025] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('247680ec-824d-41ac-8735-1edb7b119a99',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.216426] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f3bde114-3afc-44d9-b700-031059700635 with status ACTIVE [ 716.216656] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.216803] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.216894] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.217141] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.217229] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.217467] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.217574] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.217635] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.217813] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.217941] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.218081] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.218176] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.218233] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.218389] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.218477] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.218758] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f3bde114-3afc-44d9-b700-031059700635 is going to be updated. [ 716.244879] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.244879] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.244879] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.244879] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.244879] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.244879] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f3bde114-3afc-44d9-b700-031059700635" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.302122] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.302365] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.302451] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.302710] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.302858] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.302989] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac589e4e-a2e5-4716-8490-eecefc1b6a5e already deleted. [ 716.303103] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac589e4e-a2e5-4716-8490-eecefc1b6a5e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.531351] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-8672d193-ffc9-46be-83d4-064399b66865 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.531491] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8672d193-ffc9-46be-83d4-064399b66865" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.531705] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8672d193-ffc9-46be-83d4-064399b66865',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.532764] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.532875] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.532946] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.533161] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.533253] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.533436] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.533531] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.533634] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.533750] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.533819] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.533908] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f78f149-d978-4089-8aa8-d480e7d7bb61 already deleted. [ 716.533986] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f78f149-d978-4089-8aa8-d480e7d7bb61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.546215] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 13e7208e-9aea-49f5-a81f-05de005dbcb0 with status ACTIVE [ 716.546953] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.546953] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.546953] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.547186] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.547186] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.547311] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.547487] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.547545] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.547715] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.547792] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.547981] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.548094] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.548146] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.548300] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.548384] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.548476] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 13e7208e-9aea-49f5-a81f-05de005dbcb0 is going to be updated. [ 716.574029] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.574205] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.574205] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.576027] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.576027] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.576027] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-13e7208e-9aea-49f5-a81f-05de005dbcb0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.673916] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 87729ccf-b5c1-4c71-b616-13269541067e: rpc.has_security_group_logging(os_id): False [ 716.697152] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.697316] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.697416] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.697647] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.697766] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.697920] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.698056] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.698090] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.698243] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.699327] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.699327] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.699327] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.699327] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.699327] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.699327] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.699327] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.699327] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.699327] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.699327] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.700195] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.700195] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 87729ccf-b5c1-4c71-b616-13269541067e is going to be created. [ 716.720345] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('247680ec-824d-41ac-8735-1edb7b119a99',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.749601] env[70392]: INFO networking_nsxv3.common.synchronization [None req-737bdec5-084a-4345-bdb3-a1b70c60fc4f None None] Enqueued Resource ID: 3cc7905c-2ea2-4ec4-960c-25b4ba36b2e0 with Priority: HIGHEST for action port [ 716.751163] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cc7905c-2ea2-4ec4-960c-25b4ba36b2e0 with Priority: HIGHEST for action port [ 716.752724] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-3cc7905c-2ea2-4ec4-960c-25b4ba36b2e0 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.752724] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3cc7905c-2ea2-4ec4-960c-25b4ba36b2e0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.752724] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3cc7905c-2ea2-4ec4-960c-25b4ba36b2e0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.752724] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3cc7905c-2ea2-4ec4-960c-25b4ba36b2e0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.752724] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3cc7905c-2ea2-4ec4-960c-25b4ba36b2e0',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.775301] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.775488] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.775605] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.775816] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.776036] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.794898] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 87729ccf-b5c1-4c71-b616-13269541067e in Status: IN_PROGRESS for 2s [ 717.041809] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8672d193-ffc9-46be-83d4-064399b66865',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.223374] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.223807] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.223807] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.223880] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.225022] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.225022] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 247680ec-824d-41ac-8735-1edb7b119a99 is going to be created. [ 717.259519] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3cc7905c-2ea2-4ec4-960c-25b4ba36b2e0 [ 717.259519] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.259519] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.259519] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.259519] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.259519] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.259519] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3cc7905c-2ea2-4ec4-960c-25b4ba36b2e0 already deleted. [ 717.259519] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3cc7905c-2ea2-4ec4-960c-25b4ba36b2e0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.280281] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.280524] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.280524] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.282947] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.282947] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.293240] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 247680ec-824d-41ac-8735-1edb7b119a99 in Status: UNINITIALIZED for 2s [ 717.545793] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.547194] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.547194] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.547194] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.547194] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.547436] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8672d193-ffc9-46be-83d4-064399b66865 is going to be created. [ 717.578324] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.578324] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.578324] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.578324] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.578324] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.593110] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8672d193-ffc9-46be-83d4-064399b66865 in Status: UNINITIALIZED for 2s [ 717.706282] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-934 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.706282] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-934" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.706282] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-934" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.706282] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-934" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.706282] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.706282] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.706282] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.708816] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.708996] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.710120] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 717.710120] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 717.710693] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 717.710900] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 717.711643] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 717.711643] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 717.711643] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 717.739586] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 717.740630] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 717.740630] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 717.740630] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-934" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.740630] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-d0a26605-3ddb-40bf-96b5-ca26e04083f8 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.740630] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-d0a26605-3ddb-40bf-96b5-ca26e04083f8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.740909] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-d0a26605-3ddb-40bf-96b5-ca26e04083f8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.741756] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-d0a26605-3ddb-40bf-96b5-ca26e04083f8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.741756] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0a26605-3ddb-40bf-96b5-ca26e04083f8',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.849479] env[70392]: INFO networking_nsxv3.common.synchronization [req-ad2680a6-852d-42e6-8d1e-f17a75946586 req-2256a7dc-ee8c-4bac-ab42-05824705c7be tempest-ServersAdminNegativeTestJSON-1845401423 tempest-ServersAdminNegativeTestJSON-1845401423-project-member] Enqueued Resource ID: 59adf132-72f4-4d43-847e-1af9bc3c6073 with Priority: HIGHEST for action security_group_members [ 717.855190] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59adf132-72f4-4d43-847e-1af9bc3c6073 with Priority: HIGHEST for action security_group_members [ 717.855190] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-59adf132-72f4-4d43-847e-1af9bc3c6073 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.855190] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59adf132-72f4-4d43-847e-1af9bc3c6073" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.855190] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59adf132-72f4-4d43-847e-1af9bc3c6073" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.855190] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59adf132-72f4-4d43-847e-1af9bc3c6073" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.855190] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.855190] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.855190] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.855190] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.855190] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.855190] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('59adf132-72f4-4d43-847e-1af9bc3c6073',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.893609] env[70392]: INFO networking_nsxv3.common.synchronization [None req-b848bce9-0c02-4d42-be4c-310b30a051f7 None None] Enqueued Resource ID: 197b2e44-6c1e-4b5b-a83b-cd1b23e18015 with Priority: HIGHEST for action port [ 717.893920] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 197b2e44-6c1e-4b5b-a83b-cd1b23e18015 with Priority: HIGHEST for action port [ 717.894673] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-197b2e44-6c1e-4b5b-a83b-cd1b23e18015 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.894819] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-197b2e44-6c1e-4b5b-a83b-cd1b23e18015" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.894880] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-197b2e44-6c1e-4b5b-a83b-cd1b23e18015" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.895276] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-197b2e44-6c1e-4b5b-a83b-cd1b23e18015" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.895397] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('197b2e44-6c1e-4b5b-a83b-cd1b23e18015',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.244149] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.244582] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.244684] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.245097] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.245334] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.245528] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port d0a26605-3ddb-40bf-96b5-ca26e04083f8 not found, creating... [ 718.245814] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.245982] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.246115] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.246359] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.246508] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.246831] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.246965] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.247772] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.248106] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.248317] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.248703] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: d0a26605-3ddb-40bf-96b5-ca26e04083f8 is going to be created. [ 718.278470] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.278729] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.278828] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.279137] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.279373] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.279604] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-d0a26605-3ddb-40bf-96b5-ca26e04083f8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.363420] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('59adf132-72f4-4d43-847e-1af9bc3c6073',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.398558] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 197b2e44-6c1e-4b5b-a83b-cd1b23e18015 [ 718.398738] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.398883] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.399026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.399352] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.399518] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.399685] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:197b2e44-6c1e-4b5b-a83b-cd1b23e18015 already deleted. [ 718.399845] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-197b2e44-6c1e-4b5b-a83b-cd1b23e18015" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.775663] env[70392]: INFO networking_nsxv3.common.synchronization [None req-4f66647c-fb76-4072-8e3f-3d23a51f586c None None] Enqueued Resource ID: f27a45af-a33d-4caa-981e-14f9a0832025 with Priority: HIGHEST for action port [ 718.777026] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f27a45af-a33d-4caa-981e-14f9a0832025 with Priority: HIGHEST for action port [ 718.777459] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-f27a45af-a33d-4caa-981e-14f9a0832025 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.777751] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f27a45af-a33d-4caa-981e-14f9a0832025" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.777751] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f27a45af-a33d-4caa-981e-14f9a0832025" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.778215] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f27a45af-a33d-4caa-981e-14f9a0832025" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.778738] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f27a45af-a33d-4caa-981e-14f9a0832025',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.812088] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 87729ccf-b5c1-4c71-b616-13269541067e in Status: SUCCESS [ 718.812088] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-87729ccf-b5c1-4c71-b616-13269541067e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.866827] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('59adf132-72f4-4d43-847e-1af9bc3c6073',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.103027] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-325 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.103027] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-325" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.103027] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-325" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.103027] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-325" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.103027] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.103027] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.104664] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.105444] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.105779] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.109024] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 719.109024] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 719.109024] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 719.109024] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 719.109024] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 719.109024] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 719.109024] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 719.130394] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 719.130737] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 719.130980] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 719.131338] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-325" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.133229] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-3080720d-f5a9-42f1-921c-47a81529fc8f taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.133229] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-3080720d-f5a9-42f1-921c-47a81529fc8f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.133229] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-3080720d-f5a9-42f1-921c-47a81529fc8f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.133229] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-3080720d-f5a9-42f1-921c-47a81529fc8f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.133547] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3080720d-f5a9-42f1-921c-47a81529fc8f',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.216620] env[70392]: INFO networking_nsxv3.common.synchronization [req-29101e3d-1455-4c8f-b667-9c47b497883e req-748128d5-f769-4a5c-986e-2d37afaefa0f tempest-DeleteServersTestJSON-1676313022 tempest-DeleteServersTestJSON-1676313022-project-member] Enqueued Resource ID: ce79170a-31ce-429e-8e08-a911557872f4 with Priority: HIGHEST for action security_group_members [ 719.216620] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce79170a-31ce-429e-8e08-a911557872f4 with Priority: HIGHEST for action security_group_members [ 719.216620] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce79170a-31ce-429e-8e08-a911557872f4 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.216620] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.216620] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.216620] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.216620] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.216620] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.216620] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.216620] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.216620] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.216620] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce79170a-31ce-429e-8e08-a911557872f4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.235340] env[70392]: INFO networking_nsxv3.common.synchronization [req-ae90ac63-b841-4d28-9d8c-058c105e7615 req-58ac0e16-1d22-43aa-81ff-d954d58046ae service nova] Enqueued Resource ID: 7f78f149-d978-4089-8aa8-d480e7d7bb61 with Priority: HIGHEST for action security_group_rules [ 719.235340] env[70392]: INFO networking_nsxv3.common.synchronization [req-ae90ac63-b841-4d28-9d8c-058c105e7615 req-58ac0e16-1d22-43aa-81ff-d954d58046ae service nova] Enqueued Resource ID: 7f78f149-d978-4089-8aa8-d480e7d7bb61 with Priority: HIGHEST for action security_group_members [ 719.235340] env[70392]: INFO networking_nsxv3.common.synchronization [req-ae90ac63-b841-4d28-9d8c-058c105e7615 req-58ac0e16-1d22-43aa-81ff-d954d58046ae service nova] Enqueued Resource ID: d0a26605-3ddb-40bf-96b5-ca26e04083f8 with Priority: HIGHEST for action port [ 719.237394] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f78f149-d978-4089-8aa8-d480e7d7bb61 with Priority: HIGHEST for action security_group_rules [ 719.237564] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f78f149-d978-4089-8aa8-d480e7d7bb61 with Priority: HIGHEST for action security_group_members [ 719.237671] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0a26605-3ddb-40bf-96b5-ca26e04083f8 with Priority: HIGHEST for action port [ 719.238493] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f78f149-d978-4089-8aa8-d480e7d7bb61 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.238493] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f78f149-d978-4089-8aa8-d480e7d7bb61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.238641] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f78f149-d978-4089-8aa8-d480e7d7bb61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.238807] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f78f149-d978-4089-8aa8-d480e7d7bb61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.238943] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f78f149-d978-4089-8aa8-d480e7d7bb61',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.241843] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f78f149-d978-4089-8aa8-d480e7d7bb61 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.242099] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f78f149-d978-4089-8aa8-d480e7d7bb61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.242099] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f78f149-d978-4089-8aa8-d480e7d7bb61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.242285] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f78f149-d978-4089-8aa8-d480e7d7bb61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.242447] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.242568] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.242651] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.242782] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.244364] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.244364] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f78f149-d978-4089-8aa8-d480e7d7bb61',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.244951] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-d0a26605-3ddb-40bf-96b5-ca26e04083f8 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.245419] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d0a26605-3ddb-40bf-96b5-ca26e04083f8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.245515] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d0a26605-3ddb-40bf-96b5-ca26e04083f8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.245757] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d0a26605-3ddb-40bf-96b5-ca26e04083f8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.246899] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0a26605-3ddb-40bf-96b5-ca26e04083f8',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.283092] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f27a45af-a33d-4caa-981e-14f9a0832025 [ 719.283367] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.284333] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.284333] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.284333] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.284333] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.284333] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f27a45af-a33d-4caa-981e-14f9a0832025 already deleted. [ 719.284333] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f27a45af-a33d-4caa-981e-14f9a0832025" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.306230] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 247680ec-824d-41ac-8735-1edb7b119a99 in Status: SUCCESS [ 719.307345] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-247680ec-824d-41ac-8735-1edb7b119a99" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.307345] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-247680ec-824d-41ac-8735-1edb7b119a99" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.307471] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-247680ec-824d-41ac-8735-1edb7b119a99" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.307586] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.308899] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.308899] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.308899] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.308899] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.308899] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-247680ec-824d-41ac-8735-1edb7b119a99" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.308899] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('247680ec-824d-41ac-8735-1edb7b119a99',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.374244] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.374394] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.374463] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.374668] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.375015] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.375015] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59adf132-72f4-4d43-847e-1af9bc3c6073 is going to be updated. [ 719.425157] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.425327] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.425390] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.425622] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.425768] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.435676] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59adf132-72f4-4d43-847e-1af9bc3c6073 in Status: IN_PROGRESS for 2s [ 719.604378] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8672d193-ffc9-46be-83d4-064399b66865 in Status: SUCCESS [ 719.604598] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8672d193-ffc9-46be-83d4-064399b66865" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.604827] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8672d193-ffc9-46be-83d4-064399b66865" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.604998] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8672d193-ffc9-46be-83d4-064399b66865" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.605243] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.605368] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.605490] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.605539] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.605637] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.605723] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8672d193-ffc9-46be-83d4-064399b66865" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.605815] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8672d193-ffc9-46be-83d4-064399b66865',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.635893] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.636907] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.636907] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.636907] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.640209] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.640209] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 3080720d-f5a9-42f1-921c-47a81529fc8f not found, creating... [ 719.640209] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.640209] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.640209] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.640209] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.640209] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.640209] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.640209] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.640209] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.640681] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.640681] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.640681] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 3080720d-f5a9-42f1-921c-47a81529fc8f is going to be created. [ 719.660913] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.661243] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.661393] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.661555] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.661786] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.662014] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-3080720d-f5a9-42f1-921c-47a81529fc8f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.717533] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.717804] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.717860] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.718138] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.718235] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.718429] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.718533] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.718616] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.718779] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.718870] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.718962] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce79170a-31ce-429e-8e08-a911557872f4 is going to be updated. [ 719.750152] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f78f149-d978-4089-8aa8-d480e7d7bb61 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.750152] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f78f149-d978-4089-8aa8-d480e7d7bb61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.750152] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7f78f149-d978-4089-8aa8-d480e7d7bb61',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.750884] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d0a26605-3ddb-40bf-96b5-ca26e04083f8 with status ACTIVE [ 719.751167] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.751250] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.751316] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.751550] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.751639] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.751874] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.751941] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.751978] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.761019] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.761019] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.761019] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.761019] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.761019] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.761019] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.761019] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.761019] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d0a26605-3ddb-40bf-96b5-ca26e04083f8 is going to be updated. [ 719.771168] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.773476] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.773590] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.773827] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.773973] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.795257] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce79170a-31ce-429e-8e08-a911557872f4 in Status: IN_PROGRESS for 2s [ 719.806131] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.806331] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.806375] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.806969] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.806969] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.806969] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d0a26605-3ddb-40bf-96b5-ca26e04083f8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.813160] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('247680ec-824d-41ac-8735-1edb7b119a99',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.112678] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-8672d193-ffc9-46be-83d4-064399b66865 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.112959] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8672d193-ffc9-46be-83d4-064399b66865" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.112959] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8672d193-ffc9-46be-83d4-064399b66865" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.113233] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8672d193-ffc9-46be-83d4-064399b66865" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.113413] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.113529] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.113618] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.114316] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.114316] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.114316] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8672d193-ffc9-46be-83d4-064399b66865" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.114316] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-8672d193-ffc9-46be-83d4-064399b66865 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.114316] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8672d193-ffc9-46be-83d4-064399b66865" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.114316] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8672d193-ffc9-46be-83d4-064399b66865" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.115223] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8672d193-ffc9-46be-83d4-064399b66865" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.115223] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.115223] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.115223] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.115223] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.115223] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.115223] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8672d193-ffc9-46be-83d4-064399b66865" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.115223] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8672d193-ffc9-46be-83d4-064399b66865',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.261196] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7f78f149-d978-4089-8aa8-d480e7d7bb61',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.286465] env[70392]: INFO networking_nsxv3.common.synchronization [None req-8dc63aab-092b-4008-ab2a-92bf05c7c4fe tempest-VolumesAdminNegativeTest-687729453 tempest-VolumesAdminNegativeTest-687729453-project-member] Enqueued Resource ID: 5142002e-26fc-486e-b9c2-236f95ba1fa4 with Priority: HIGHEST for action security_group_rules [ 720.287753] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5142002e-26fc-486e-b9c2-236f95ba1fa4 with Priority: HIGHEST for action security_group_rules [ 720.288626] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5142002e-26fc-486e-b9c2-236f95ba1fa4 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.288937] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5142002e-26fc-486e-b9c2-236f95ba1fa4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.289116] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5142002e-26fc-486e-b9c2-236f95ba1fa4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.289475] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5142002e-26fc-486e-b9c2-236f95ba1fa4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.289653] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5142002e-26fc-486e-b9c2-236f95ba1fa4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.315833] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 247680ec-824d-41ac-8735-1edb7b119a99: rpc.has_security_group_logging(os_id): False [ 720.345348] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.345570] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.345570] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.348173] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.348173] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.348173] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.348173] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.348173] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.348173] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.348173] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.348173] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 247680ec-824d-41ac-8735-1edb7b119a99 is going to be created. [ 720.438286] env[70392]: INFO networking_nsxv3.common.synchronization [None req-d4a3a682-2f2f-4517-9b1a-21c41f4a10e3 tempest-VolumesAdminNegativeTest-687729453 tempest-VolumesAdminNegativeTest-687729453-project-member] Enqueued Resource ID: 5142002e-26fc-486e-b9c2-236f95ba1fa4 with Priority: HIGHEST for action security_group_rules [ 720.439927] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5142002e-26fc-486e-b9c2-236f95ba1fa4 with Priority: HIGHEST for action security_group_rules [ 720.439927] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5142002e-26fc-486e-b9c2-236f95ba1fa4 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.439927] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5142002e-26fc-486e-b9c2-236f95ba1fa4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.478143] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.478334] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.478428] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.478678] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.479674] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.492298] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 247680ec-824d-41ac-8735-1edb7b119a99 in Status: IN_PROGRESS for 2s [ 720.617965] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8672d193-ffc9-46be-83d4-064399b66865: rpc.has_security_group_logging(os_id): False [ 720.646931] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.647528] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.647528] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.647528] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.647528] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.647793] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.647856] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.647917] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.648106] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.648193] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.649497] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.649497] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.649661] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.649722] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.651425] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.651736] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.651857] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.651927] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.652125] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.652220] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.652312] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8672d193-ffc9-46be-83d4-064399b66865 is going to be created. [ 720.711979] env[70392]: INFO networking_nsxv3.common.synchronization [None req-472ae4eb-62c8-44f3-86a7-0136f9fb2ab4 None None] Enqueued Resource ID: 39cacc62-07f2-4803-af2e-63b4c6c44ebe with Priority: HIGHEST for action port [ 720.712287] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39cacc62-07f2-4803-af2e-63b4c6c44ebe with Priority: HIGHEST for action port [ 720.712957] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-39cacc62-07f2-4803-af2e-63b4c6c44ebe taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.713110] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-39cacc62-07f2-4803-af2e-63b4c6c44ebe" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.713150] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-39cacc62-07f2-4803-af2e-63b4c6c44ebe" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.714429] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-39cacc62-07f2-4803-af2e-63b4c6c44ebe" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.714429] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39cacc62-07f2-4803-af2e-63b4c6c44ebe',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.733994] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.734271] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.734359] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.734976] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.734976] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.749563] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8672d193-ffc9-46be-83d4-064399b66865 in Status: IN_PROGRESS for 2s [ 720.766445] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.766445] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.766445] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.766445] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.766445] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.766445] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f78f149-d978-4089-8aa8-d480e7d7bb61 is going to be created. [ 720.802726] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.805027] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.805027] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.805027] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.805027] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.828488] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.828488] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.828488] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.828488] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.828488] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.828488] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5142002e-26fc-486e-b9c2-236f95ba1fa4 already deleted. [ 720.828488] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5142002e-26fc-486e-b9c2-236f95ba1fa4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.828488] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5142002e-26fc-486e-b9c2-236f95ba1fa4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.828488] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5142002e-26fc-486e-b9c2-236f95ba1fa4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.828488] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5142002e-26fc-486e-b9c2-236f95ba1fa4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.837299] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f78f149-d978-4089-8aa8-d480e7d7bb61 in Status: UNINITIALIZED for 2s [ 720.977594] env[70392]: INFO networking_nsxv3.common.synchronization [req-ad2680a6-852d-42e6-8d1e-f17a75946586 req-6020326d-5f22-4220-910e-ba7bff726510 service nova] Enqueued Resource ID: 59adf132-72f4-4d43-847e-1af9bc3c6073 with Priority: HIGHEST for action security_group_rules [ 720.979515] env[70392]: INFO networking_nsxv3.common.synchronization [req-ad2680a6-852d-42e6-8d1e-f17a75946586 req-6020326d-5f22-4220-910e-ba7bff726510 service nova] Enqueued Resource ID: 59adf132-72f4-4d43-847e-1af9bc3c6073 with Priority: HIGHEST for action security_group_members [ 720.979515] env[70392]: INFO networking_nsxv3.common.synchronization [req-ad2680a6-852d-42e6-8d1e-f17a75946586 req-6020326d-5f22-4220-910e-ba7bff726510 service nova] Enqueued Resource ID: 3080720d-f5a9-42f1-921c-47a81529fc8f with Priority: HIGHEST for action port [ 720.980114] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59adf132-72f4-4d43-847e-1af9bc3c6073 with Priority: HIGHEST for action security_group_rules [ 720.982472] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59adf132-72f4-4d43-847e-1af9bc3c6073 with Priority: HIGHEST for action security_group_members [ 720.982472] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3080720d-f5a9-42f1-921c-47a81529fc8f with Priority: HIGHEST for action port [ 720.982472] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-59adf132-72f4-4d43-847e-1af9bc3c6073 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.982472] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-59adf132-72f4-4d43-847e-1af9bc3c6073" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.982472] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-59adf132-72f4-4d43-847e-1af9bc3c6073" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.982472] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-59adf132-72f4-4d43-847e-1af9bc3c6073" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.982905] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('59adf132-72f4-4d43-847e-1af9bc3c6073',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.984582] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-59adf132-72f4-4d43-847e-1af9bc3c6073 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.984714] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59adf132-72f4-4d43-847e-1af9bc3c6073" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.985023] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-3080720d-f5a9-42f1-921c-47a81529fc8f taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.985231] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3080720d-f5a9-42f1-921c-47a81529fc8f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.985231] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3080720d-f5a9-42f1-921c-47a81529fc8f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.986309] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3080720d-f5a9-42f1-921c-47a81529fc8f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.986495] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3080720d-f5a9-42f1-921c-47a81529fc8f',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.218602] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 39cacc62-07f2-4803-af2e-63b4c6c44ebe [ 721.218602] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.218881] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.218881] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.219173] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.219244] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.219315] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:39cacc62-07f2-4803-af2e-63b4c6c44ebe already deleted. [ 721.219416] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-39cacc62-07f2-4803-af2e-63b4c6c44ebe" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.241105] env[70392]: INFO networking_nsxv3.common.synchronization [req-7765f457-3d27-4e1b-aea6-1974c0a8fa04 req-5085ca6c-c4eb-4029-9f12-bfb02597bd33 tempest-SecurityGroupRulesTestJSON-1182738387 tempest-SecurityGroupRulesTestJSON-1182738387-project-member] Enqueued Resource ID: f0639f2c-d0fe-4d4b-b2cc-91ceac86dc1e with Priority: HIGHEST for action security_group_rules [ 721.244343] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0639f2c-d0fe-4d4b-b2cc-91ceac86dc1e with Priority: HIGHEST for action security_group_rules [ 721.244343] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f0639f2c-d0fe-4d4b-b2cc-91ceac86dc1e taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.244343] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f0639f2c-d0fe-4d4b-b2cc-91ceac86dc1e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.244343] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f0639f2c-d0fe-4d4b-b2cc-91ceac86dc1e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.244343] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f0639f2c-d0fe-4d4b-b2cc-91ceac86dc1e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.244343] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f0639f2c-d0fe-4d4b-b2cc-91ceac86dc1e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.363886] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.364249] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.364299] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.364569] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.364680] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.364802] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5142002e-26fc-486e-b9c2-236f95ba1fa4 already deleted. [ 721.364900] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5142002e-26fc-486e-b9c2-236f95ba1fa4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.452309] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59adf132-72f4-4d43-847e-1af9bc3c6073 in Status: SUCCESS [ 721.452529] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59adf132-72f4-4d43-847e-1af9bc3c6073" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.452646] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59adf132-72f4-4d43-847e-1af9bc3c6073" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.452909] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59adf132-72f4-4d43-847e-1af9bc3c6073" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.453152] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.453278] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.453363] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.453605] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.453687] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.453856] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('59adf132-72f4-4d43-847e-1af9bc3c6073',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.492201] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-59adf132-72f4-4d43-847e-1af9bc3c6073 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.492201] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59adf132-72f4-4d43-847e-1af9bc3c6073" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.492201] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3080720d-f5a9-42f1-921c-47a81529fc8f with status ACTIVE [ 721.492201] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.492201] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.492201] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.492201] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.492201] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.492201] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.492201] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.492201] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.492201] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.492201] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.492201] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.492941] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.492941] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.492941] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.492941] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.492941] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3080720d-f5a9-42f1-921c-47a81529fc8f is going to be updated. [ 721.520492] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.520738] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.521389] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.521389] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.521389] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.522367] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3080720d-f5a9-42f1-921c-47a81529fc8f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.765503] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.765621] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.765661] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.765877] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.765991] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.766636] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f0639f2c-d0fe-4d4b-b2cc-91ceac86dc1e already deleted. [ 721.766766] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f0639f2c-d0fe-4d4b-b2cc-91ceac86dc1e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.810927] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce79170a-31ce-429e-8e08-a911557872f4 in Status: SUCCESS [ 721.811172] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce79170a-31ce-429e-8e08-a911557872f4 deletion is rescheduled due to dependency. [ 721.811295] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.958267] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('59adf132-72f4-4d43-847e-1af9bc3c6073',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.462370] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('59adf132-72f4-4d43-847e-1af9bc3c6073',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.514279] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 247680ec-824d-41ac-8735-1edb7b119a99 in Status: SUCCESS [ 722.515820] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-247680ec-824d-41ac-8735-1edb7b119a99" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.556082] env[70392]: INFO networking_nsxv3.common.synchronization [None req-64082a16-afcb-4908-8c36-5dfaccc051e1 tempest-AttachInterfacesTestJSON-2046649887 tempest-AttachInterfacesTestJSON-2046649887-project-member] Enqueued Resource ID: c1385665-0c09-423f-98c4-4d6b46c66ec0 with Priority: HIGHEST for action security_group_rules [ 722.556082] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1385665-0c09-423f-98c4-4d6b46c66ec0 with Priority: HIGHEST for action security_group_rules [ 722.556082] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c1385665-0c09-423f-98c4-4d6b46c66ec0 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.556652] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c1385665-0c09-423f-98c4-4d6b46c66ec0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.556652] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c1385665-0c09-423f-98c4-4d6b46c66ec0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.559076] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c1385665-0c09-423f-98c4-4d6b46c66ec0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.559200] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c1385665-0c09-423f-98c4-4d6b46c66ec0',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.651314] env[70392]: INFO networking_nsxv3.common.synchronization [None req-6a074115-e0bb-483b-aba1-02eb44cad09a tempest-AttachInterfacesTestJSON-2046649887 tempest-AttachInterfacesTestJSON-2046649887-project-member] Enqueued Resource ID: c1385665-0c09-423f-98c4-4d6b46c66ec0 with Priority: HIGHEST for action security_group_rules [ 722.651314] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1385665-0c09-423f-98c4-4d6b46c66ec0 with Priority: HIGHEST for action security_group_rules [ 722.652224] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c1385665-0c09-423f-98c4-4d6b46c66ec0 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.652696] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c1385665-0c09-423f-98c4-4d6b46c66ec0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.763638] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8672d193-ffc9-46be-83d4-064399b66865 in Status: SUCCESS [ 722.763916] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8672d193-ffc9-46be-83d4-064399b66865" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.847881] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f78f149-d978-4089-8aa8-d480e7d7bb61 in Status: SUCCESS [ 722.848091] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f78f149-d978-4089-8aa8-d480e7d7bb61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.848255] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f78f149-d978-4089-8aa8-d480e7d7bb61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.848481] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f78f149-d978-4089-8aa8-d480e7d7bb61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.848683] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.848802] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.848868] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.849034] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.849123] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.849214] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f78f149-d978-4089-8aa8-d480e7d7bb61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.849305] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7f78f149-d978-4089-8aa8-d480e7d7bb61',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.965556] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.966081] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.966217] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.966555] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.966693] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.966838] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59adf132-72f4-4d43-847e-1af9bc3c6073 is going to be updated. [ 723.011293] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.011539] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.011799] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.012145] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.012145] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.027396] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59adf132-72f4-4d43-847e-1af9bc3c6073 in Status: IN_PROGRESS for 2s [ 723.083491] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.083951] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.084228] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.084731] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.084932] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.085127] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c1385665-0c09-423f-98c4-4d6b46c66ec0 already deleted. [ 723.085311] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c1385665-0c09-423f-98c4-4d6b46c66ec0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.085721] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c1385665-0c09-423f-98c4-4d6b46c66ec0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.086060] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c1385665-0c09-423f-98c4-4d6b46c66ec0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.086277] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c1385665-0c09-423f-98c4-4d6b46c66ec0',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.355029] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7f78f149-d978-4089-8aa8-d480e7d7bb61',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.618739] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.619205] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.619205] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.619205] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.619346] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.619346] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c1385665-0c09-423f-98c4-4d6b46c66ec0 already deleted. [ 723.619411] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c1385665-0c09-423f-98c4-4d6b46c66ec0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.856981] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7f78f149-d978-4089-8aa8-d480e7d7bb61: rpc.has_security_group_logging(os_id): False [ 723.878069] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.878213] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.878310] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.878504] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.878611] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.878853] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.878960] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.879025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.879180] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.879253] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.879336] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f78f149-d978-4089-8aa8-d480e7d7bb61 is going to be created. [ 723.955198] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.955737] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.955737] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.955737] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.955964] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.978185] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f78f149-d978-4089-8aa8-d480e7d7bb61 in Status: IN_PROGRESS for 2s [ 724.323396] env[70392]: INFO networking_nsxv3.common.synchronization [req-4e52c731-c62d-4e48-8169-62021cfaddbd req-454ac61e-7332-4459-9e1c-e1504e16a8d1 tempest-ServersTestFqdnHostnames-1925581123 tempest-ServersTestFqdnHostnames-1925581123-project-member] Enqueued Resource ID: cca6e4dd-68c9-4fd2-8e1a-cda645da02e4 with Priority: HIGHEST for action security_group_members [ 724.323396] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cca6e4dd-68c9-4fd2-8e1a-cda645da02e4 with Priority: HIGHEST for action security_group_members [ 724.323396] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-cca6e4dd-68c9-4fd2-8e1a-cda645da02e4 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.323396] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cca6e4dd-68c9-4fd2-8e1a-cda645da02e4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.323396] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cca6e4dd-68c9-4fd2-8e1a-cda645da02e4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.323970] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cca6e4dd-68c9-4fd2-8e1a-cda645da02e4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.324245] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.324483] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.324645] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.325026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.325802] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.325802] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cca6e4dd-68c9-4fd2-8e1a-cda645da02e4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.828037] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.828037] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.828479] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.828479] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.828479] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.828757] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.828867] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.828932] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.829129] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.829205] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.829298] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cca6e4dd-68c9-4fd2-8e1a-cda645da02e4 already deleted. [ 724.829380] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cca6e4dd-68c9-4fd2-8e1a-cda645da02e4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.041649] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59adf132-72f4-4d43-847e-1af9bc3c6073 in Status: SUCCESS [ 725.041649] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59adf132-72f4-4d43-847e-1af9bc3c6073" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.041649] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59adf132-72f4-4d43-847e-1af9bc3c6073" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.041649] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59adf132-72f4-4d43-847e-1af9bc3c6073" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.041649] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.041649] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.043910] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.044200] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.044262] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.044365] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59adf132-72f4-4d43-847e-1af9bc3c6073" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.044617] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('59adf132-72f4-4d43-847e-1af9bc3c6073',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.047119] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-482 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.047334] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-482" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.047462] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-482" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.047889] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-482" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.052191] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.052405] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.056020] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.056020] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.056020] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.056020] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 725.056020] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 725.056020] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 725.056020] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 725.056020] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 725.056020] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 725.056020] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 725.075943] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 725.076202] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 725.076427] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 725.076713] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-482" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.077209] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-13d7b6a9-124b-4760-8f0c-191e7c50cf85 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.077489] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-13d7b6a9-124b-4760-8f0c-191e7c50cf85" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.077681] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-13d7b6a9-124b-4760-8f0c-191e7c50cf85" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.078026] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-13d7b6a9-124b-4760-8f0c-191e7c50cf85" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.078171] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('13d7b6a9-124b-4760-8f0c-191e7c50cf85',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.534134] env[70392]: INFO networking_nsxv3.common.synchronization [req-09d5e805-98a2-4ec5-b57f-551af182b543 req-9017ecae-cda9-44a1-a1ed-b32b48fddd2e tempest-SecurityGroupRulesTestJSON-1182738387 tempest-SecurityGroupRulesTestJSON-1182738387-project-member] Enqueued Resource ID: bff85519-e820-469d-8721-adebe8c75c76 with Priority: HIGHEST for action security_group_rules [ 725.534700] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bff85519-e820-469d-8721-adebe8c75c76 with Priority: HIGHEST for action security_group_rules [ 725.535009] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bff85519-e820-469d-8721-adebe8c75c76 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.535554] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bff85519-e820-469d-8721-adebe8c75c76" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.535704] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bff85519-e820-469d-8721-adebe8c75c76" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.536192] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bff85519-e820-469d-8721-adebe8c75c76" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.536192] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bff85519-e820-469d-8721-adebe8c75c76',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.556564] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-59adf132-72f4-4d43-847e-1af9bc3c6073 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.556722] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59adf132-72f4-4d43-847e-1af9bc3c6073" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.556792] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59adf132-72f4-4d43-847e-1af9bc3c6073" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.557039] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59adf132-72f4-4d43-847e-1af9bc3c6073" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.557203] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.557300] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.557360] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.557541] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.557646] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.557782] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59adf132-72f4-4d43-847e-1af9bc3c6073" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.557881] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-59adf132-72f4-4d43-847e-1af9bc3c6073 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.561020] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59adf132-72f4-4d43-847e-1af9bc3c6073" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.561020] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59adf132-72f4-4d43-847e-1af9bc3c6073" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.561020] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59adf132-72f4-4d43-847e-1af9bc3c6073" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.561020] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.561020] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.561020] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.561020] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.561020] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.561020] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59adf132-72f4-4d43-847e-1af9bc3c6073" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.561020] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('59adf132-72f4-4d43-847e-1af9bc3c6073',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.582022] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.582022] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.582022] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.582022] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.582022] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.582022] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 13d7b6a9-124b-4760-8f0c-191e7c50cf85 not found, creating... [ 725.582022] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.582022] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.582022] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.582493] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.582493] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.582723] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.582877] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.582991] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.583214] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.583348] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.583486] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 13d7b6a9-124b-4760-8f0c-191e7c50cf85 is going to be created. [ 725.609719] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.610130] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.610298] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.610667] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.610931] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.611256] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-13d7b6a9-124b-4760-8f0c-191e7c50cf85" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.996329] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f78f149-d978-4089-8aa8-d480e7d7bb61 in Status: SUCCESS [ 725.996329] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f78f149-d978-4089-8aa8-d480e7d7bb61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.059362] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.059454] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.059727] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.059727] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.060203] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.060203] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bff85519-e820-469d-8721-adebe8c75c76 already deleted. [ 726.060370] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bff85519-e820-469d-8721-adebe8c75c76" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.064392] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 59adf132-72f4-4d43-847e-1af9bc3c6073: rpc.has_security_group_logging(os_id): False [ 726.083027] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.083233] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.083316] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.083476] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.083571] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.083769] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.083898] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.083984] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.084601] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.084601] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.084601] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.084601] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.084601] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.084601] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.084900] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.084900] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.084979] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.085355] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.085355] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.085733] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.085733] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 59adf132-72f4-4d43-847e-1af9bc3c6073 is going to be updated. [ 726.163706] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.163871] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.163971] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.164249] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.164845] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.185616] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 59adf132-72f4-4d43-847e-1af9bc3c6073 in Status: IN_PROGRESS for 2s [ 726.645746] env[70392]: INFO networking_nsxv3.common.synchronization [req-4e52c731-c62d-4e48-8169-62021cfaddbd req-23bd1764-c702-4ef3-aa83-4007a9e42381 service nova] Enqueued Resource ID: cca6e4dd-68c9-4fd2-8e1a-cda645da02e4 with Priority: HIGHEST for action security_group_rules [ 726.645963] env[70392]: INFO networking_nsxv3.common.synchronization [req-4e52c731-c62d-4e48-8169-62021cfaddbd req-23bd1764-c702-4ef3-aa83-4007a9e42381 service nova] Enqueued Resource ID: cca6e4dd-68c9-4fd2-8e1a-cda645da02e4 with Priority: HIGHEST for action security_group_members [ 726.646134] env[70392]: INFO networking_nsxv3.common.synchronization [req-4e52c731-c62d-4e48-8169-62021cfaddbd req-23bd1764-c702-4ef3-aa83-4007a9e42381 service nova] Enqueued Resource ID: 13d7b6a9-124b-4760-8f0c-191e7c50cf85 with Priority: HIGHEST for action port [ 726.646690] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cca6e4dd-68c9-4fd2-8e1a-cda645da02e4 with Priority: HIGHEST for action security_group_rules [ 726.646829] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cca6e4dd-68c9-4fd2-8e1a-cda645da02e4 with Priority: HIGHEST for action security_group_members [ 726.647048] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13d7b6a9-124b-4760-8f0c-191e7c50cf85 with Priority: HIGHEST for action port [ 726.652439] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cca6e4dd-68c9-4fd2-8e1a-cda645da02e4 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.652605] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cca6e4dd-68c9-4fd2-8e1a-cda645da02e4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.652675] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cca6e4dd-68c9-4fd2-8e1a-cda645da02e4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.652902] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cca6e4dd-68c9-4fd2-8e1a-cda645da02e4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.652989] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cca6e4dd-68c9-4fd2-8e1a-cda645da02e4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.654063] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-cca6e4dd-68c9-4fd2-8e1a-cda645da02e4 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.654175] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cca6e4dd-68c9-4fd2-8e1a-cda645da02e4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.654268] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cca6e4dd-68c9-4fd2-8e1a-cda645da02e4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.654478] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cca6e4dd-68c9-4fd2-8e1a-cda645da02e4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.654632] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.654730] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.654794] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.654937] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.656796] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.656910] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cca6e4dd-68c9-4fd2-8e1a-cda645da02e4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.659025] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-13d7b6a9-124b-4760-8f0c-191e7c50cf85 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.659025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-13d7b6a9-124b-4760-8f0c-191e7c50cf85" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.659025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-13d7b6a9-124b-4760-8f0c-191e7c50cf85" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.659219] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-13d7b6a9-124b-4760-8f0c-191e7c50cf85" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.659219] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('13d7b6a9-124b-4760-8f0c-191e7c50cf85',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.678819] env[70392]: INFO networking_nsxv3.common.synchronization [req-65812f8e-01f9-492b-8209-3242507e1646 req-a3a59eba-1245-459f-9507-9fa54c9c9eb0 tempest-ServerDiagnosticsTest-636566878 tempest-ServerDiagnosticsTest-636566878-project-member] Enqueued Resource ID: 440b9e9c-7b34-46fd-9988-db4bdb111a55 with Priority: HIGHEST for action security_group_members [ 726.679370] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 440b9e9c-7b34-46fd-9988-db4bdb111a55 with Priority: HIGHEST for action security_group_members [ 726.679709] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-440b9e9c-7b34-46fd-9988-db4bdb111a55 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.679812] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-440b9e9c-7b34-46fd-9988-db4bdb111a55" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.679856] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-440b9e9c-7b34-46fd-9988-db4bdb111a55" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.680115] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-440b9e9c-7b34-46fd-9988-db4bdb111a55" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.680307] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.680416] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.680472] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.680630] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.680770] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.680835] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('440b9e9c-7b34-46fd-9988-db4bdb111a55',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.163258] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 13d7b6a9-124b-4760-8f0c-191e7c50cf85 with status ACTIVE [ 727.163258] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.163657] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.163657] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.163747] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.163778] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.163978] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.164090] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.164145] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.164286] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.164371] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.164560] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.164659] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.164697] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.164842] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.164962] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.165011] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 13d7b6a9-124b-4760-8f0c-191e7c50cf85 is going to be updated. [ 727.166481] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cca6e4dd-68c9-4fd2-8e1a-cda645da02e4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.167763] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-cca6e4dd-68c9-4fd2-8e1a-cda645da02e4 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.167851] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cca6e4dd-68c9-4fd2-8e1a-cda645da02e4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.184070] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.184456] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.184456] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.184640] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.185180] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.185180] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.185180] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.185180] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.185180] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.185410] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.185410] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 440b9e9c-7b34-46fd-9988-db4bdb111a55 is going to be updated. [ 727.196772] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.197022] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.197623] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.197623] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.198171] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.198171] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-13d7b6a9-124b-4760-8f0c-191e7c50cf85" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.285680] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.285680] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.285820] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.285946] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.286109] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.302438] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 440b9e9c-7b34-46fd-9988-db4bdb111a55 in Status: IN_PROGRESS for 2s [ 727.669499] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cca6e4dd-68c9-4fd2-8e1a-cda645da02e4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.174719] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.174719] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.174719] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.174719] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.174719] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.174719] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cca6e4dd-68c9-4fd2-8e1a-cda645da02e4 is going to be created. [ 728.220446] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 59adf132-72f4-4d43-847e-1af9bc3c6073 in Status: SUCCESS [ 728.220748] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-59adf132-72f4-4d43-847e-1af9bc3c6073" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.233195] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.236215] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.236314] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.236557] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.236731] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.270191] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cca6e4dd-68c9-4fd2-8e1a-cda645da02e4 in Status: UNINITIALIZED for 2s [ 729.313330] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 440b9e9c-7b34-46fd-9988-db4bdb111a55 in Status: SUCCESS [ 729.313726] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 440b9e9c-7b34-46fd-9988-db4bdb111a55 deletion is rescheduled due to dependency. [ 729.313726] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-440b9e9c-7b34-46fd-9988-db4bdb111a55" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.441096] env[70392]: INFO networking_nsxv3.common.synchronization [req-0076ef63-bffd-4b46-8a67-837bb8e1bebf req-0d125529-9ed7-446d-be7e-6c53602b8023 tempest-ImagesOneServerNegativeTestJSON-1691594958 tempest-ImagesOneServerNegativeTestJSON-1691594958-project-member] Enqueued Resource ID: dbeb3b19-0a8e-4685-84e0-239c82418063 with Priority: HIGHEST for action security_group_members [ 729.441722] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbeb3b19-0a8e-4685-84e0-239c82418063 with Priority: HIGHEST for action security_group_members [ 729.442036] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbeb3b19-0a8e-4685-84e0-239c82418063 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.442834] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.442834] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.442834] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.442834] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.442834] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.443093] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.444246] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.444299] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.444403] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbeb3b19-0a8e-4685-84e0-239c82418063',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.842196] env[70392]: INFO networking_nsxv3.common.synchronization [req-0b98a399-b191-43c2-8879-29c238dc3666 req-81c0a69c-1a5e-440a-8919-e1bb26978a76 tempest-InstanceActionsV221TestJSON-1001043171 tempest-InstanceActionsV221TestJSON-1001043171-project-member] Enqueued Resource ID: 8672d193-ffc9-46be-83d4-064399b66865 with Priority: HIGHEST for action security_group_members [ 729.842786] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8672d193-ffc9-46be-83d4-064399b66865 with Priority: HIGHEST for action security_group_members [ 729.843102] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-8672d193-ffc9-46be-83d4-064399b66865 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.843223] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8672d193-ffc9-46be-83d4-064399b66865" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.843285] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8672d193-ffc9-46be-83d4-064399b66865" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.843485] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8672d193-ffc9-46be-83d4-064399b66865" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.843632] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.843722] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.843780] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.843921] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.844012] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.844103] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8672d193-ffc9-46be-83d4-064399b66865',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.873934] env[70392]: INFO networking_nsxv3.common.synchronization [req-83c8ec1e-aafc-4543-a8a5-ab863d2ebcca req-002169e4-cbe1-4876-a388-46f5f99aab79 tempest-ServerDiskConfigTestJSON-277542510 tempest-ServerDiskConfigTestJSON-277542510-project-member] Enqueued Resource ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 with Priority: HIGHEST for action security_group_members [ 729.873934] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 with Priority: HIGHEST for action security_group_members [ 729.873934] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60d7eaa-9583-4c75-97fa-4049c63576b6 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.874711] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.875747] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.875974] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.876341] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.876341] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.876341] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.876504] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.876584] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.877256] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b60d7eaa-9583-4c75-97fa-4049c63576b6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.947958] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.948988] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.949144] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.949324] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.949644] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.949644] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.949880] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.949880] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.949993] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.950077] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.950155] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbeb3b19-0a8e-4685-84e0-239c82418063 already deleted. [ 729.950245] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.139986] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-686 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.140251] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-686" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.140741] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-686" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.140741] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-686" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.141614] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.141614] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.141890] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.141890] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.142095] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.142325] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 730.142456] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 730.142578] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 730.142819] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 730.142819] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 730.142991] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 730.143103] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 730.165040] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 730.165271] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 730.165435] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 730.165635] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-686" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.165999] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-d3d04ccf-35b3-4566-bfa5-e366548adbd3 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.166224] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-d3d04ccf-35b3-4566-bfa5-e366548adbd3" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.166373] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-d3d04ccf-35b3-4566-bfa5-e366548adbd3" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.166790] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-d3d04ccf-35b3-4566-bfa5-e366548adbd3" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.167140] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3d04ccf-35b3-4566-bfa5-e366548adbd3',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.287147] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cca6e4dd-68c9-4fd2-8e1a-cda645da02e4 in Status: SUCCESS [ 730.287403] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cca6e4dd-68c9-4fd2-8e1a-cda645da02e4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.287608] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cca6e4dd-68c9-4fd2-8e1a-cda645da02e4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.287951] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cca6e4dd-68c9-4fd2-8e1a-cda645da02e4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.290117] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.290117] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.290117] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.290117] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.290117] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.290117] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cca6e4dd-68c9-4fd2-8e1a-cda645da02e4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.290117] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cca6e4dd-68c9-4fd2-8e1a-cda645da02e4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.347465] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.347903] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.347903] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.348057] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.348128] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.348343] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.348922] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.348922] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.348922] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.348922] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.348922] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8672d193-ffc9-46be-83d4-064399b66865 is going to be updated. [ 730.378525] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.378708] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.378801] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.379018] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.379121] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.379340] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.379436] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.379508] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.379667] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.379747] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.379836] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 is going to be updated. [ 730.384666] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.384826] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.384895] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.385167] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.385314] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.396842] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8672d193-ffc9-46be-83d4-064399b66865 in Status: IN_PROGRESS for 2s [ 730.414169] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.414169] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.414169] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.414390] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.414429] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.424873] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 in Status: IN_PROGRESS for 2s [ 730.582339] env[70392]: INFO networking_nsxv3.common.synchronization [req-b1be4926-0c9b-4c4a-93a3-12788ef226d8 req-e5cfa1f0-a661-4e7e-9a10-2cf5cdc38ecb tempest-SecurityGroupRulesTestJSON-1182738387 tempest-SecurityGroupRulesTestJSON-1182738387-project-member] Enqueued Resource ID: 287eac67-339d-47e9-8cac-8db33bda76e0 with Priority: HIGHEST for action security_group_rules [ 730.583222] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 287eac67-339d-47e9-8cac-8db33bda76e0 with Priority: HIGHEST for action security_group_rules [ 730.584262] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-287eac67-339d-47e9-8cac-8db33bda76e0 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.584515] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-287eac67-339d-47e9-8cac-8db33bda76e0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.584653] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-287eac67-339d-47e9-8cac-8db33bda76e0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.585136] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-287eac67-339d-47e9-8cac-8db33bda76e0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.585136] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('287eac67-339d-47e9-8cac-8db33bda76e0',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.672821] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.673067] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.673194] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.673469] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.673644] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.673781] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port d3d04ccf-35b3-4566-bfa5-e366548adbd3 not found, creating... [ 730.674053] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.674207] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.674321] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.674539] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.674681] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.674963] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.675122] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.675235] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.675437] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.675565] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.675730] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: d3d04ccf-35b3-4566-bfa5-e366548adbd3 is going to be created. [ 730.701406] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.701684] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.701837] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.702213] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.702583] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.702986] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-d3d04ccf-35b3-4566-bfa5-e366548adbd3" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.795181] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cca6e4dd-68c9-4fd2-8e1a-cda645da02e4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.112943] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.113169] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.113229] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.113426] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.113514] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.113615] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 287eac67-339d-47e9-8cac-8db33bda76e0 already deleted. [ 731.113922] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-287eac67-339d-47e9-8cac-8db33bda76e0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.255393] env[70392]: INFO networking_nsxv3.common.synchronization [req-f2a7a98e-6635-4a66-b986-228caeeb948a req-9b6c20c4-f98c-4a0b-8100-21752bc8c7bc tempest-InstanceActionsTestJSON-83943407 tempest-InstanceActionsTestJSON-83943407-project-member] Enqueued Resource ID: 5ade0934-09a2-4e5c-ac36-e235101fed11 with Priority: HIGHEST for action security_group_members [ 731.256867] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ade0934-09a2-4e5c-ac36-e235101fed11 with Priority: HIGHEST for action security_group_members [ 731.257368] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ade0934-09a2-4e5c-ac36-e235101fed11 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.257546] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ade0934-09a2-4e5c-ac36-e235101fed11" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.257648] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ade0934-09a2-4e5c-ac36-e235101fed11" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.257984] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ade0934-09a2-4e5c-ac36-e235101fed11" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.259016] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.259016] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.259016] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.259016] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.259016] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.259016] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5ade0934-09a2-4e5c-ac36-e235101fed11',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.297562] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cca6e4dd-68c9-4fd2-8e1a-cda645da02e4: rpc.has_security_group_logging(os_id): False [ 731.320175] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.320441] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.320525] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.320751] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.320854] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.321160] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.321286] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.321350] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.321514] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.321603] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.321695] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cca6e4dd-68c9-4fd2-8e1a-cda645da02e4 is going to be created. [ 731.393282] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.393590] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.393590] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.393691] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.395508] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.412093] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cca6e4dd-68c9-4fd2-8e1a-cda645da02e4 in Status: IN_PROGRESS for 2s [ 731.764672] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.765860] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.765860] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.766384] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.766384] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.766498] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.766595] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.770110] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.770110] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.770110] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.770110] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ade0934-09a2-4e5c-ac36-e235101fed11 is going to be updated. [ 731.773133] env[70392]: INFO networking_nsxv3.common.synchronization [req-0076ef63-bffd-4b46-8a67-837bb8e1bebf req-e5bd405b-49ae-4d17-bc79-7fda0b4f268a service nova] Enqueued Resource ID: dbeb3b19-0a8e-4685-84e0-239c82418063 with Priority: HIGHEST for action security_group_rules [ 731.773133] env[70392]: INFO networking_nsxv3.common.synchronization [req-0076ef63-bffd-4b46-8a67-837bb8e1bebf req-e5bd405b-49ae-4d17-bc79-7fda0b4f268a service nova] Enqueued Resource ID: dbeb3b19-0a8e-4685-84e0-239c82418063 with Priority: HIGHEST for action security_group_members [ 731.773133] env[70392]: INFO networking_nsxv3.common.synchronization [req-0076ef63-bffd-4b46-8a67-837bb8e1bebf req-e5bd405b-49ae-4d17-bc79-7fda0b4f268a service nova] Enqueued Resource ID: d3d04ccf-35b3-4566-bfa5-e366548adbd3 with Priority: HIGHEST for action port [ 731.774053] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbeb3b19-0a8e-4685-84e0-239c82418063 with Priority: HIGHEST for action security_group_rules [ 731.774053] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbeb3b19-0a8e-4685-84e0-239c82418063 with Priority: HIGHEST for action security_group_members [ 731.774053] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3d04ccf-35b3-4566-bfa5-e366548adbd3 with Priority: HIGHEST for action port [ 731.775715] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dbeb3b19-0a8e-4685-84e0-239c82418063 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.775715] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.775715] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.776575] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.776575] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dbeb3b19-0a8e-4685-84e0-239c82418063',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.777527] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbeb3b19-0a8e-4685-84e0-239c82418063 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.778119] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.778221] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.778453] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.778685] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.778804] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.778906] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.779121] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.779209] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.779306] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbeb3b19-0a8e-4685-84e0-239c82418063',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.784932] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-d3d04ccf-35b3-4566-bfa5-e366548adbd3 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.784932] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d3d04ccf-35b3-4566-bfa5-e366548adbd3" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.784932] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d3d04ccf-35b3-4566-bfa5-e366548adbd3" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.784932] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d3d04ccf-35b3-4566-bfa5-e366548adbd3" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.784932] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3d04ccf-35b3-4566-bfa5-e366548adbd3',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.815023] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.815218] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.815258] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.815843] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.815843] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.827185] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ade0934-09a2-4e5c-ac36-e235101fed11 in Status: IN_PROGRESS for 2s [ 732.285010] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbeb3b19-0a8e-4685-84e0-239c82418063 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.285010] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.286348] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dbeb3b19-0a8e-4685-84e0-239c82418063',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.287319] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d3d04ccf-35b3-4566-bfa5-e366548adbd3 with status ACTIVE [ 732.287585] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.287714] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.287714] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.287969] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.288059] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.288249] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.288353] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.288478] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.288794] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.288794] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.289097] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.289097] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.289097] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.289525] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.289525] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.289525] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d3d04ccf-35b3-4566-bfa5-e366548adbd3 is going to be updated. [ 732.325928] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.326824] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.326944] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.327291] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.327526] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.327789] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d3d04ccf-35b3-4566-bfa5-e366548adbd3" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.418087] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8672d193-ffc9-46be-83d4-064399b66865 in Status: SUCCESS [ 732.418087] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8672d193-ffc9-46be-83d4-064399b66865 deletion is rescheduled due to dependency. [ 732.418087] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8672d193-ffc9-46be-83d4-064399b66865" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.443224] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 in Status: SUCCESS [ 732.443432] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 deletion is rescheduled due to dependency. [ 732.443584] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.798354] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dbeb3b19-0a8e-4685-84e0-239c82418063',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.302348] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.302522] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.302574] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.302910] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.303131] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.303246] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbeb3b19-0a8e-4685-84e0-239c82418063 is going to be created. [ 733.331721] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.331940] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.331940] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.332214] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.332471] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.344983] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbeb3b19-0a8e-4685-84e0-239c82418063 in Status: UNINITIALIZED for 2s [ 733.428655] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cca6e4dd-68c9-4fd2-8e1a-cda645da02e4 in Status: SUCCESS [ 733.428655] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cca6e4dd-68c9-4fd2-8e1a-cda645da02e4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.838388] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ade0934-09a2-4e5c-ac36-e235101fed11 in Status: SUCCESS [ 733.838650] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ade0934-09a2-4e5c-ac36-e235101fed11 deletion is rescheduled due to dependency. [ 733.839046] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ade0934-09a2-4e5c-ac36-e235101fed11" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.208412] env[70392]: INFO networking_nsxv3.common.synchronization [req-b1800661-f775-4b45-91f5-61d4d6e8ca35 req-958cba1f-c330-4011-834d-58255396f08c tempest-SecurityGroupRulesTestJSON-1182738387 tempest-SecurityGroupRulesTestJSON-1182738387-project-member] Enqueued Resource ID: 2ed063bb-45fa-4a46-baa4-88130a3b3fe5 with Priority: HIGHEST for action security_group_rules [ 734.209412] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ed063bb-45fa-4a46-baa4-88130a3b3fe5 with Priority: HIGHEST for action security_group_rules [ 734.209412] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ed063bb-45fa-4a46-baa4-88130a3b3fe5 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.209629] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ed063bb-45fa-4a46-baa4-88130a3b3fe5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.209629] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ed063bb-45fa-4a46-baa4-88130a3b3fe5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.210399] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ed063bb-45fa-4a46-baa4-88130a3b3fe5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.210509] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ed063bb-45fa-4a46-baa4-88130a3b3fe5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.733830] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.734320] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.734320] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.734320] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.734440] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.734739] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ed063bb-45fa-4a46-baa4-88130a3b3fe5 already deleted. [ 734.734739] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ed063bb-45fa-4a46-baa4-88130a3b3fe5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.831445] env[70392]: INFO networking_nsxv3.common.synchronization [req-7835db5c-d851-4517-bc69-56ce25ba0eda req-f70a6a32-b349-4a89-ac01-28c03e15941d tempest-AttachInterfacesV270Test-687848131 tempest-AttachInterfacesV270Test-687848131-project-member] Enqueued Resource ID: bc70a526-b91f-4303-b621-493cba506202 with Priority: HIGHEST for action security_group_members [ 734.831907] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc70a526-b91f-4303-b621-493cba506202 with Priority: HIGHEST for action security_group_members [ 734.832217] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc70a526-b91f-4303-b621-493cba506202 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.832366] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc70a526-b91f-4303-b621-493cba506202" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.832428] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc70a526-b91f-4303-b621-493cba506202" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.832682] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc70a526-b91f-4303-b621-493cba506202" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.832836] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.832964] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.833623] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.833827] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.833920] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.834037] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc70a526-b91f-4303-b621-493cba506202',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.338957] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.339075] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.339147] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.339320] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.342416] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.342416] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.342416] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.342416] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.342416] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.342416] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.342416] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc70a526-b91f-4303-b621-493cba506202 already deleted. [ 735.342416] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc70a526-b91f-4303-b621-493cba506202" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.355963] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbeb3b19-0a8e-4685-84e0-239c82418063 in Status: SUCCESS [ 735.358307] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.358307] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.358307] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.358307] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.358307] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.358307] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.358307] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.358307] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.358307] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.358307] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dbeb3b19-0a8e-4685-84e0-239c82418063',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.728598] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-345 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.728796] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-345" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.729042] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-345" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.729395] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-345" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.729693] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.729895] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.731302] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.731632] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.731850] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.732977] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 735.736222] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 735.736572] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 735.736572] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 735.736692] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 735.736756] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 735.736899] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 735.760293] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 735.760463] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 735.760631] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 735.760820] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-345" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.761158] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-75bb5d99-741e-4436-b9eb-6bc86898be63 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.761333] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-75bb5d99-741e-4436-b9eb-6bc86898be63" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.761591] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-75bb5d99-741e-4436-b9eb-6bc86898be63" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.761827] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-75bb5d99-741e-4436-b9eb-6bc86898be63" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.762425] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75bb5d99-741e-4436-b9eb-6bc86898be63',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.807945] env[70392]: INFO networking_nsxv3.common.synchronization [None req-44ef9211-a26f-453d-b28c-a909cf84548c None None] Enqueued Resource ID: 7207c031-6e58-4966-862b-586e8920d575 with Priority: HIGHEST for action port [ 735.808370] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7207c031-6e58-4966-862b-586e8920d575 with Priority: HIGHEST for action port [ 735.808918] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-7207c031-6e58-4966-862b-586e8920d575 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.809070] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7207c031-6e58-4966-862b-586e8920d575" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.809129] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7207c031-6e58-4966-862b-586e8920d575" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.809380] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7207c031-6e58-4966-862b-586e8920d575" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.809453] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7207c031-6e58-4966-862b-586e8920d575',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.861960] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbeb3b19-0a8e-4685-84e0-239c82418063 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.861960] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.861960] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.864935] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.864935] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.864935] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.864935] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.864935] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.864935] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.864935] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.864935] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbeb3b19-0a8e-4685-84e0-239c82418063 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.864935] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.864935] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.864935] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.864935] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.864935] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.864935] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.864935] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.864935] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.864935] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.864935] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dbeb3b19-0a8e-4685-84e0-239c82418063',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.264649] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.264899] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.265088] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.265294] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.265450] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.265607] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 75bb5d99-741e-4436-b9eb-6bc86898be63 not found, creating... [ 736.265908] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.266084] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.266205] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.266484] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.266572] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.266881] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.266992] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.267129] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.267343] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.267606] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.267804] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 75bb5d99-741e-4436-b9eb-6bc86898be63 is going to be created. [ 736.289461] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.289671] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.289725] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.290075] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.290276] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.290427] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-75bb5d99-741e-4436-b9eb-6bc86898be63" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.312051] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7207c031-6e58-4966-862b-586e8920d575 [ 736.312352] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.312437] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.312505] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.312744] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.312839] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.312936] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7207c031-6e58-4966-862b-586e8920d575 already deleted. [ 736.313203] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7207c031-6e58-4966-862b-586e8920d575" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.369206] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dbeb3b19-0a8e-4685-84e0-239c82418063: rpc.has_security_group_logging(os_id): False [ 736.390441] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.390612] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.390700] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.390955] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.391056] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.391285] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.391443] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.391531] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.391719] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.393901] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.393901] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.393901] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.393901] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.393901] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.393901] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.393901] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.393901] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.393901] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.393901] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.393901] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.393901] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dbeb3b19-0a8e-4685-84e0-239c82418063 is going to be created. [ 736.502708] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.502708] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.502708] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.502708] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.502708] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.523655] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dbeb3b19-0a8e-4685-84e0-239c82418063 in Status: IN_PROGRESS for 2s [ 736.553509] env[70392]: INFO networking_nsxv3.common.synchronization [req-c4e401dc-e97c-4fe3-ac34-7156e7e4f854 req-0a6eb91e-68e9-4188-92ec-2868614d4e24 tempest-FloatingIPsAssociationNegativeTestJSON-1867118597 tempest-FloatingIPsAssociationNegativeTestJSON-1867118597-project-member] Enqueued Resource ID: 623be016-3395-49f1-ae71-2a2052cde818 with Priority: HIGHEST for action security_group_members [ 736.554872] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 623be016-3395-49f1-ae71-2a2052cde818 with Priority: HIGHEST for action security_group_members [ 736.555504] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-623be016-3395-49f1-ae71-2a2052cde818 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.557624] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-623be016-3395-49f1-ae71-2a2052cde818" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.557793] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-623be016-3395-49f1-ae71-2a2052cde818" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.557996] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-623be016-3395-49f1-ae71-2a2052cde818" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.558211] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.558385] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.558556] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.558725] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.558883] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.559077] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('623be016-3395-49f1-ae71-2a2052cde818',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.063315] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.063315] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.063315] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.063315] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.063315] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.063315] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.063315] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.063315] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.064118] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.064118] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.064118] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 623be016-3395-49f1-ae71-2a2052cde818 is going to be updated. [ 737.095563] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.095777] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.095861] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.096097] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.096244] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.105979] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 623be016-3395-49f1-ae71-2a2052cde818 in Status: IN_PROGRESS for 2s [ 737.725869] env[70392]: INFO networking_nsxv3.common.synchronization [req-7835db5c-d851-4517-bc69-56ce25ba0eda req-2fe952e3-0192-4e79-87aa-6599c6533e48 service nova] Enqueued Resource ID: bc70a526-b91f-4303-b621-493cba506202 with Priority: HIGHEST for action security_group_rules [ 737.725869] env[70392]: INFO networking_nsxv3.common.synchronization [req-7835db5c-d851-4517-bc69-56ce25ba0eda req-2fe952e3-0192-4e79-87aa-6599c6533e48 service nova] Enqueued Resource ID: bc70a526-b91f-4303-b621-493cba506202 with Priority: HIGHEST for action security_group_members [ 737.725869] env[70392]: INFO networking_nsxv3.common.synchronization [req-7835db5c-d851-4517-bc69-56ce25ba0eda req-2fe952e3-0192-4e79-87aa-6599c6533e48 service nova] Enqueued Resource ID: 75bb5d99-741e-4436-b9eb-6bc86898be63 with Priority: HIGHEST for action port [ 737.725869] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc70a526-b91f-4303-b621-493cba506202 with Priority: HIGHEST for action security_group_rules [ 737.725869] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc70a526-b91f-4303-b621-493cba506202 with Priority: HIGHEST for action security_group_members [ 737.725869] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75bb5d99-741e-4436-b9eb-6bc86898be63 with Priority: HIGHEST for action port [ 737.725869] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bc70a526-b91f-4303-b621-493cba506202 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.726225] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bc70a526-b91f-4303-b621-493cba506202" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.726225] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bc70a526-b91f-4303-b621-493cba506202" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.726344] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bc70a526-b91f-4303-b621-493cba506202" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.726390] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bc70a526-b91f-4303-b621-493cba506202',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.727285] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc70a526-b91f-4303-b621-493cba506202 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.727423] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc70a526-b91f-4303-b621-493cba506202" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.727477] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc70a526-b91f-4303-b621-493cba506202" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.728136] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc70a526-b91f-4303-b621-493cba506202" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.728136] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.728136] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.728136] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.728420] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.728420] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.728522] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc70a526-b91f-4303-b621-493cba506202',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.731437] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-75bb5d99-741e-4436-b9eb-6bc86898be63 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.731437] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-75bb5d99-741e-4436-b9eb-6bc86898be63" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.731437] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-75bb5d99-741e-4436-b9eb-6bc86898be63" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.731437] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-75bb5d99-741e-4436-b9eb-6bc86898be63" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.731437] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75bb5d99-741e-4436-b9eb-6bc86898be63',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.234490] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc70a526-b91f-4303-b621-493cba506202 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.234490] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc70a526-b91f-4303-b621-493cba506202" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.234838] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bc70a526-b91f-4303-b621-493cba506202',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.235621] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 75bb5d99-741e-4436-b9eb-6bc86898be63 with status ACTIVE [ 738.235876] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.235990] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.236049] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.236234] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.236344] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.236492] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.236616] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.236655] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.236808] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.236884] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.237075] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.237169] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.237220] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.237358] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.237430] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.237515] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 75bb5d99-741e-4436-b9eb-6bc86898be63 is going to be updated. [ 738.266093] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.266319] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.266319] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.266528] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.266691] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.266905] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-75bb5d99-741e-4436-b9eb-6bc86898be63" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.315739] env[70392]: INFO networking_nsxv3.common.synchronization [req-6d746708-942e-4a37-bcbc-17a2c97e1787 req-6f7e0146-8115-49af-a753-1d72802f3573 tempest-SecurityGroupRulesTestJSON-1182738387 tempest-SecurityGroupRulesTestJSON-1182738387-project-member] Enqueued Resource ID: 81bad2a8-a836-4a52-aab2-ab2524718510 with Priority: HIGHEST for action security_group_rules [ 738.316767] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81bad2a8-a836-4a52-aab2-ab2524718510 with Priority: HIGHEST for action security_group_rules [ 738.317253] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-81bad2a8-a836-4a52-aab2-ab2524718510 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.317360] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-81bad2a8-a836-4a52-aab2-ab2524718510" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.317405] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-81bad2a8-a836-4a52-aab2-ab2524718510" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.317877] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-81bad2a8-a836-4a52-aab2-ab2524718510" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.317877] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('81bad2a8-a836-4a52-aab2-ab2524718510',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.430298] env[70392]: INFO networking_nsxv3.common.synchronization [None req-8d8323be-1070-4927-859f-fddf22d474cf None None] Enqueued Resource ID: a546cd4b-1000-4b9c-9003-0a415ccf5568 with Priority: HIGHEST for action port [ 738.430859] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a546cd4b-1000-4b9c-9003-0a415ccf5568 with Priority: HIGHEST for action port [ 738.431602] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-a546cd4b-1000-4b9c-9003-0a415ccf5568 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.431740] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a546cd4b-1000-4b9c-9003-0a415ccf5568" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.431740] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a546cd4b-1000-4b9c-9003-0a415ccf5568" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.431980] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a546cd4b-1000-4b9c-9003-0a415ccf5568" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.432120] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a546cd4b-1000-4b9c-9003-0a415ccf5568',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.537597] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dbeb3b19-0a8e-4685-84e0-239c82418063 in Status: SUCCESS [ 738.537864] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.644965] env[70392]: INFO networking_nsxv3.common.synchronization [None req-ef12e79e-50c0-4525-8e3a-3f498d1366ed None None] Enqueued Resource ID: cef627ad-cfc7-4a48-9d96-916b0b4dab0c with Priority: HIGHEST for action port [ 738.645539] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cef627ad-cfc7-4a48-9d96-916b0b4dab0c with Priority: HIGHEST for action port [ 738.645864] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-cef627ad-cfc7-4a48-9d96-916b0b4dab0c taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.645982] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cef627ad-cfc7-4a48-9d96-916b0b4dab0c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.646751] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cef627ad-cfc7-4a48-9d96-916b0b4dab0c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.648441] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cef627ad-cfc7-4a48-9d96-916b0b4dab0c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.648441] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cef627ad-cfc7-4a48-9d96-916b0b4dab0c',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.740999] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bc70a526-b91f-4303-b621-493cba506202',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.841288] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.844099] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.844099] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.844099] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.844099] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.844099] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 81bad2a8-a836-4a52-aab2-ab2524718510 already deleted. [ 738.844099] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-81bad2a8-a836-4a52-aab2-ab2524718510" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.936602] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a546cd4b-1000-4b9c-9003-0a415ccf5568 [ 738.936838] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.936982] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.937072] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.937296] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.937418] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.937475] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a546cd4b-1000-4b9c-9003-0a415ccf5568 already deleted. [ 738.937571] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a546cd4b-1000-4b9c-9003-0a415ccf5568" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.118177] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 623be016-3395-49f1-ae71-2a2052cde818 in Status: SUCCESS [ 739.119187] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 623be016-3395-49f1-ae71-2a2052cde818 deletion is rescheduled due to dependency. [ 739.119312] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-623be016-3395-49f1-ae71-2a2052cde818" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.152156] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cef627ad-cfc7-4a48-9d96-916b0b4dab0c [ 739.152156] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.152156] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.152156] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.152156] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.152156] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.152156] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cef627ad-cfc7-4a48-9d96-916b0b4dab0c already deleted. [ 739.152156] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cef627ad-cfc7-4a48-9d96-916b0b4dab0c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.248546] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.248926] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.248926] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.249145] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.249145] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.249254] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc70a526-b91f-4303-b621-493cba506202 is going to be created. [ 739.282484] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.282692] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.282766] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.283054] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.283233] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.295074] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc70a526-b91f-4303-b621-493cba506202 in Status: UNINITIALIZED for 2s [ 739.313176] env[70392]: INFO networking_nsxv3.common.synchronization [req-c5001d1b-1425-4fed-948f-6921a717103c req-1086b533-2dc9-4c39-bc4d-710a4f1d91e4 tempest-SecurityGroupRulesTestJSON-1182738387 tempest-SecurityGroupRulesTestJSON-1182738387-project-member] Enqueued Resource ID: 81bad2a8-a836-4a52-aab2-ab2524718510 with Priority: HIGHEST for action security_group_rules [ 739.313684] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81bad2a8-a836-4a52-aab2-ab2524718510 with Priority: HIGHEST for action security_group_rules [ 739.314026] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-81bad2a8-a836-4a52-aab2-ab2524718510 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.314155] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-81bad2a8-a836-4a52-aab2-ab2524718510" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.314222] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-81bad2a8-a836-4a52-aab2-ab2524718510" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.314417] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-81bad2a8-a836-4a52-aab2-ab2524718510" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.314506] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('81bad2a8-a836-4a52-aab2-ab2524718510',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.837192] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.837352] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.837403] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.837618] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.837706] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.837796] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 81bad2a8-a836-4a52-aab2-ab2524718510 already deleted. [ 739.837904] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-81bad2a8-a836-4a52-aab2-ab2524718510" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.460574] env[70392]: INFO networking_nsxv3.common.synchronization [None req-c28bb818-d103-432c-80cd-31a78c461141 tempest-ServersTestJSON-998170705 tempest-ServersTestJSON-998170705-project-member] Enqueued Resource ID: e91c56eb-c593-402a-8bcc-78c2b86ccae6 with Priority: HIGHEST for action security_group_rules [ 740.460574] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e91c56eb-c593-402a-8bcc-78c2b86ccae6 with Priority: HIGHEST for action security_group_rules [ 740.463620] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e91c56eb-c593-402a-8bcc-78c2b86ccae6 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.464223] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e91c56eb-c593-402a-8bcc-78c2b86ccae6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.464302] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e91c56eb-c593-402a-8bcc-78c2b86ccae6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.464563] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e91c56eb-c593-402a-8bcc-78c2b86ccae6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.464707] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e91c56eb-c593-402a-8bcc-78c2b86ccae6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.608276] env[70392]: INFO networking_nsxv3.common.synchronization [None req-f2019203-a41c-4679-bdb9-81c6dbc4d195 tempest-ServersTestJSON-998170705 tempest-ServersTestJSON-998170705-project-member] Enqueued Resource ID: e91c56eb-c593-402a-8bcc-78c2b86ccae6 with Priority: HIGHEST for action security_group_rules [ 740.608886] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e91c56eb-c593-402a-8bcc-78c2b86ccae6 with Priority: HIGHEST for action security_group_rules [ 740.608886] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e91c56eb-c593-402a-8bcc-78c2b86ccae6 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.609034] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e91c56eb-c593-402a-8bcc-78c2b86ccae6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.884631] env[70392]: INFO networking_nsxv3.common.synchronization [None req-33ebdee3-2754-4cbf-b7d8-1adade88e4b4 None None] Enqueued Resource ID: 2d810796-312e-46ac-9074-0261dec22fda with Priority: HIGHEST for action port [ 740.884842] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d810796-312e-46ac-9074-0261dec22fda with Priority: HIGHEST for action port [ 740.885430] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-2d810796-312e-46ac-9074-0261dec22fda taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.885554] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2d810796-312e-46ac-9074-0261dec22fda" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.885621] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2d810796-312e-46ac-9074-0261dec22fda" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.885962] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2d810796-312e-46ac-9074-0261dec22fda" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.886054] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d810796-312e-46ac-9074-0261dec22fda',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.990289] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.990289] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.990289] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.990289] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.990289] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.990289] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e91c56eb-c593-402a-8bcc-78c2b86ccae6 already deleted. [ 740.990289] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e91c56eb-c593-402a-8bcc-78c2b86ccae6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.990711] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e91c56eb-c593-402a-8bcc-78c2b86ccae6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.990747] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e91c56eb-c593-402a-8bcc-78c2b86ccae6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.990875] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e91c56eb-c593-402a-8bcc-78c2b86ccae6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.266265] env[70392]: INFO networking_nsxv3.common.synchronization [req-7f98a2f0-8779-4165-be43-f596233575eb req-55044c8e-2bf7-4248-9a34-e174a96199d3 tempest-SecurityGroupRulesTestJSON-1182738387 tempest-SecurityGroupRulesTestJSON-1182738387-project-member] Enqueued Resource ID: 81bad2a8-a836-4a52-aab2-ab2524718510 with Priority: HIGHEST for action security_group_rules [ 741.266265] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81bad2a8-a836-4a52-aab2-ab2524718510 with Priority: HIGHEST for action security_group_rules [ 741.266265] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-81bad2a8-a836-4a52-aab2-ab2524718510 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.266265] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-81bad2a8-a836-4a52-aab2-ab2524718510" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.266265] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-81bad2a8-a836-4a52-aab2-ab2524718510" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.266527] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-81bad2a8-a836-4a52-aab2-ab2524718510" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.266723] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('81bad2a8-a836-4a52-aab2-ab2524718510',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.306680] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc70a526-b91f-4303-b621-493cba506202 in Status: SUCCESS [ 741.306680] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc70a526-b91f-4303-b621-493cba506202" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.306962] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc70a526-b91f-4303-b621-493cba506202" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.307009] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc70a526-b91f-4303-b621-493cba506202" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.308486] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.308486] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.308486] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.308486] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.308486] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.308486] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc70a526-b91f-4303-b621-493cba506202" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.308486] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bc70a526-b91f-4303-b621-493cba506202',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.389705] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2d810796-312e-46ac-9074-0261dec22fda [ 741.390910] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.391106] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.391182] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.391428] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.391598] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.391867] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2d810796-312e-46ac-9074-0261dec22fda already deleted. [ 741.391867] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2d810796-312e-46ac-9074-0261dec22fda" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.516753] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.516753] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.517785] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.517785] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.517785] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.517785] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e91c56eb-c593-402a-8bcc-78c2b86ccae6 already deleted. [ 741.517785] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e91c56eb-c593-402a-8bcc-78c2b86ccae6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.791964] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.791964] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.791964] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.791964] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.791964] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.791964] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 81bad2a8-a836-4a52-aab2-ab2524718510 already deleted. [ 741.791964] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-81bad2a8-a836-4a52-aab2-ab2524718510" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.811253] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc70a526-b91f-4303-b621-493cba506202 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.811629] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc70a526-b91f-4303-b621-493cba506202" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.811758] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc70a526-b91f-4303-b621-493cba506202" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.812040] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc70a526-b91f-4303-b621-493cba506202" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.812279] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.812439] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.812587] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.812794] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.812930] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.813070] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc70a526-b91f-4303-b621-493cba506202" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.815387] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc70a526-b91f-4303-b621-493cba506202 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.815387] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc70a526-b91f-4303-b621-493cba506202" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.815387] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc70a526-b91f-4303-b621-493cba506202" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.815387] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc70a526-b91f-4303-b621-493cba506202" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.815387] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.815387] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.815387] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.815387] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.815387] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.815387] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc70a526-b91f-4303-b621-493cba506202" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.815387] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bc70a526-b91f-4303-b621-493cba506202',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.316911] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bc70a526-b91f-4303-b621-493cba506202: rpc.has_security_group_logging(os_id): False [ 742.340812] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.340812] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.340812] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.341308] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.341412] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.341651] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.341827] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.341827] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.341998] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.342219] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.342300] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.342406] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.342491] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.342584] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.342916] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.342916] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.342916] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.343261] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.343640] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.343763] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.343862] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bc70a526-b91f-4303-b621-493cba506202 is going to be created. [ 742.427067] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.427195] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.427259] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.427458] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.427639] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.444240] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bc70a526-b91f-4303-b621-493cba506202 in Status: IN_PROGRESS for 2s [ 743.605478] env[70392]: INFO networking_nsxv3.common.synchronization [req-8462e005-ceab-43e3-814d-6266f6b87c4c req-e42d6ce4-67fe-47a6-b807-67fa498cef50 tempest-AttachVolumeTestJSON-1272662447 tempest-AttachVolumeTestJSON-1272662447-project-member] Enqueued Resource ID: ac589e4e-a2e5-4716-8490-eecefc1b6a5e with Priority: HIGHEST for action security_group_members [ 743.606016] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac589e4e-a2e5-4716-8490-eecefc1b6a5e with Priority: HIGHEST for action security_group_members [ 743.606324] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac589e4e-a2e5-4716-8490-eecefc1b6a5e taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.606470] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac589e4e-a2e5-4716-8490-eecefc1b6a5e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.606543] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac589e4e-a2e5-4716-8490-eecefc1b6a5e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.606792] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac589e4e-a2e5-4716-8490-eecefc1b6a5e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.606969] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.607133] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.607264] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.607420] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.607688] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.607867] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac589e4e-a2e5-4716-8490-eecefc1b6a5e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.112885] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.112885] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.112885] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.112885] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.112885] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.112885] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.112885] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.112885] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.112885] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.112885] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.112885] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac589e4e-a2e5-4716-8490-eecefc1b6a5e already deleted. [ 744.112885] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac589e4e-a2e5-4716-8490-eecefc1b6a5e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.317786] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-423 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.317786] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-423" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.317786] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-423" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.317786] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-423" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.317786] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.317786] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.317786] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.317786] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.317786] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.317786] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 744.317786] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 744.317786] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 744.317786] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 744.320026] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 744.320026] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 744.320026] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 744.320026] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 744.320026] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 744.320026] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 744.320026] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-423" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.320026] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-d739fb5a-7811-4a38-bef3-261ad342041b taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.320026] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-d739fb5a-7811-4a38-bef3-261ad342041b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.320026] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-d739fb5a-7811-4a38-bef3-261ad342041b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.320026] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-d739fb5a-7811-4a38-bef3-261ad342041b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.320026] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d739fb5a-7811-4a38-bef3-261ad342041b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.459727] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bc70a526-b91f-4303-b621-493cba506202 in Status: SUCCESS [ 744.459727] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bc70a526-b91f-4303-b621-493cba506202" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.776230] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.776548] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.776590] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.776904] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.777080] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.777246] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port d739fb5a-7811-4a38-bef3-261ad342041b not found, creating... [ 744.777531] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.777707] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.777927] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.778090] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.778240] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.780982] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.781226] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.781376] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.781609] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.781994] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.781994] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: d739fb5a-7811-4a38-bef3-261ad342041b is going to be created. [ 744.807309] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.807535] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.807667] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.807957] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.808269] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.808590] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-d739fb5a-7811-4a38-bef3-261ad342041b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.178720] env[70392]: INFO networking_nsxv3.common.synchronization [None req-7fb4c14b-c44b-4bd1-a2cb-0fdb024d9d4c None None] Enqueued Resource ID: db9bc24d-fdae-4381-84a1-fe8b84b2d393 with Priority: HIGHEST for action port [ 745.178720] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db9bc24d-fdae-4381-84a1-fe8b84b2d393 with Priority: HIGHEST for action port [ 745.180359] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-db9bc24d-fdae-4381-84a1-fe8b84b2d393 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.181465] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db9bc24d-fdae-4381-84a1-fe8b84b2d393" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.181465] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db9bc24d-fdae-4381-84a1-fe8b84b2d393" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.181465] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db9bc24d-fdae-4381-84a1-fe8b84b2d393" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.181465] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db9bc24d-fdae-4381-84a1-fe8b84b2d393',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.685123] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port db9bc24d-fdae-4381-84a1-fe8b84b2d393 [ 745.685680] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.685680] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.685680] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.685963] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.685963] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.685963] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:db9bc24d-fdae-4381-84a1-fe8b84b2d393 already deleted. [ 745.686129] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db9bc24d-fdae-4381-84a1-fe8b84b2d393" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.729588] env[70392]: INFO networking_nsxv3.common.synchronization [req-8462e005-ceab-43e3-814d-6266f6b87c4c req-cf2e9fec-edc8-4fe6-8310-974b2fd50103 service nova] Enqueued Resource ID: ac589e4e-a2e5-4716-8490-eecefc1b6a5e with Priority: HIGHEST for action security_group_rules [ 745.729588] env[70392]: INFO networking_nsxv3.common.synchronization [req-8462e005-ceab-43e3-814d-6266f6b87c4c req-cf2e9fec-edc8-4fe6-8310-974b2fd50103 service nova] Enqueued Resource ID: ac589e4e-a2e5-4716-8490-eecefc1b6a5e with Priority: HIGHEST for action security_group_members [ 745.729588] env[70392]: INFO networking_nsxv3.common.synchronization [req-8462e005-ceab-43e3-814d-6266f6b87c4c req-cf2e9fec-edc8-4fe6-8310-974b2fd50103 service nova] Enqueued Resource ID: d739fb5a-7811-4a38-bef3-261ad342041b with Priority: HIGHEST for action port [ 745.729588] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac589e4e-a2e5-4716-8490-eecefc1b6a5e with Priority: HIGHEST for action security_group_rules [ 745.729870] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac589e4e-a2e5-4716-8490-eecefc1b6a5e with Priority: HIGHEST for action security_group_members [ 745.729870] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d739fb5a-7811-4a38-bef3-261ad342041b with Priority: HIGHEST for action port [ 745.730314] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac589e4e-a2e5-4716-8490-eecefc1b6a5e taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.730436] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac589e4e-a2e5-4716-8490-eecefc1b6a5e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.730500] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac589e4e-a2e5-4716-8490-eecefc1b6a5e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.734020] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac589e4e-a2e5-4716-8490-eecefc1b6a5e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.734020] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac589e4e-a2e5-4716-8490-eecefc1b6a5e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.737967] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac589e4e-a2e5-4716-8490-eecefc1b6a5e taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.737967] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac589e4e-a2e5-4716-8490-eecefc1b6a5e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.737967] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac589e4e-a2e5-4716-8490-eecefc1b6a5e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.737967] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac589e4e-a2e5-4716-8490-eecefc1b6a5e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.737967] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.737967] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.737967] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.737967] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.737967] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.737967] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac589e4e-a2e5-4716-8490-eecefc1b6a5e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.740125] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-d739fb5a-7811-4a38-bef3-261ad342041b taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.740267] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d739fb5a-7811-4a38-bef3-261ad342041b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.740334] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d739fb5a-7811-4a38-bef3-261ad342041b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.741333] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d739fb5a-7811-4a38-bef3-261ad342041b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.741907] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d739fb5a-7811-4a38-bef3-261ad342041b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.929257] env[70392]: INFO networking_nsxv3.common.synchronization [req-ec5f571c-b681-4011-a917-068841312893 req-09d35226-bd88-48b2-aa23-77ed305198fe tempest-ServerRescueTestJSONUnderV235-1486079035 tempest-ServerRescueTestJSONUnderV235-1486079035-project-member] Enqueued Resource ID: d79a9e34-ff20-4d67-b0ec-c75b2bb20610 with Priority: HIGHEST for action security_group_members [ 745.929780] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d79a9e34-ff20-4d67-b0ec-c75b2bb20610 with Priority: HIGHEST for action security_group_members [ 745.934508] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-d79a9e34-ff20-4d67-b0ec-c75b2bb20610 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.934508] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d79a9e34-ff20-4d67-b0ec-c75b2bb20610" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.934508] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d79a9e34-ff20-4d67-b0ec-c75b2bb20610" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.934508] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d79a9e34-ff20-4d67-b0ec-c75b2bb20610" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.934508] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.934508] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.934508] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.934508] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.934508] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.934508] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d79a9e34-ff20-4d67-b0ec-c75b2bb20610',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.238114] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac589e4e-a2e5-4716-8490-eecefc1b6a5e taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.238264] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac589e4e-a2e5-4716-8490-eecefc1b6a5e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.243710] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ac589e4e-a2e5-4716-8490-eecefc1b6a5e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.246511] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d739fb5a-7811-4a38-bef3-261ad342041b with status ACTIVE [ 746.246835] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.246955] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.247032] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.247255] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.247346] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.247514] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.247609] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.247671] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.247820] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.247894] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.248101] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.248193] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.248253] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.248394] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.248499] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.248546] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d739fb5a-7811-4a38-bef3-261ad342041b is going to be updated. [ 746.252266] env[70392]: INFO networking_nsxv3.common.synchronization [None req-78920abe-5845-4eda-bf2d-e427f959daf2 None None] Enqueued Resource ID: 2149de0d-f044-48dc-a3f5-81a88bb635cf with Priority: HIGHEST for action port [ 746.252570] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2149de0d-f044-48dc-a3f5-81a88bb635cf with Priority: HIGHEST for action port [ 746.253671] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-2149de0d-f044-48dc-a3f5-81a88bb635cf taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.253784] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2149de0d-f044-48dc-a3f5-81a88bb635cf" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.253858] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2149de0d-f044-48dc-a3f5-81a88bb635cf" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.254089] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2149de0d-f044-48dc-a3f5-81a88bb635cf" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.254168] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2149de0d-f044-48dc-a3f5-81a88bb635cf',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.275032] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.275205] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.275261] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.275446] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.275594] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.275759] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d739fb5a-7811-4a38-bef3-261ad342041b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.438532] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.438692] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.438779] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.438980] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.439131] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.439339] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.439442] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.439504] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.439668] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.439750] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.439835] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d79a9e34-ff20-4d67-b0ec-c75b2bb20610 already deleted. [ 746.439919] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d79a9e34-ff20-4d67-b0ec-c75b2bb20610" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.703705] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-214 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.703913] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-214" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.704421] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-214" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.704756] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-214" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.705312] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.705567] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.705644] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.705942] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.706150] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.706382] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 746.706503] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 746.706617] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 746.706727] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 746.706840] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 746.706948] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 746.707094] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 746.727460] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 746.727633] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 746.727774] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 746.727955] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-214" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.728334] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-aed1fbdc-e1dd-470f-b2cb-80855c0346b5 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.729168] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-aed1fbdc-e1dd-470f-b2cb-80855c0346b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.729168] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-aed1fbdc-e1dd-470f-b2cb-80855c0346b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.730605] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-aed1fbdc-e1dd-470f-b2cb-80855c0346b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.730795] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aed1fbdc-e1dd-470f-b2cb-80855c0346b5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.749070] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ac589e4e-a2e5-4716-8490-eecefc1b6a5e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.756353] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2149de0d-f044-48dc-a3f5-81a88bb635cf [ 746.756600] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.756734] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.757591] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.757591] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.757591] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.757591] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2149de0d-f044-48dc-a3f5-81a88bb635cf already deleted. [ 746.757591] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2149de0d-f044-48dc-a3f5-81a88bb635cf" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.234952] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.235309] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.235350] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.235621] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.235778] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.235969] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port aed1fbdc-e1dd-470f-b2cb-80855c0346b5 not found, creating... [ 747.236250] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.236410] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.236527] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.236754] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.236934] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.237196] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.237349] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.237464] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.238205] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.238205] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.238205] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: aed1fbdc-e1dd-470f-b2cb-80855c0346b5 is going to be created. [ 747.250271] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.250563] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.250563] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.250773] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.250773] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.250909] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac589e4e-a2e5-4716-8490-eecefc1b6a5e is going to be created. [ 747.262023] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.262251] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.262460] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.262746] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.262977] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.263219] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-aed1fbdc-e1dd-470f-b2cb-80855c0346b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.285648] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.285648] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.285648] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.285795] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.285938] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.299529] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac589e4e-a2e5-4716-8490-eecefc1b6a5e in Status: UNINITIALIZED for 2s [ 747.979317] env[70392]: INFO networking_nsxv3.common.synchronization [req-ec5f571c-b681-4011-a917-068841312893 req-65f2af66-7738-478f-b0fe-30b59ea1c761 service nova] Enqueued Resource ID: d79a9e34-ff20-4d67-b0ec-c75b2bb20610 with Priority: HIGHEST for action security_group_rules [ 747.979607] env[70392]: INFO networking_nsxv3.common.synchronization [req-ec5f571c-b681-4011-a917-068841312893 req-65f2af66-7738-478f-b0fe-30b59ea1c761 service nova] Enqueued Resource ID: d79a9e34-ff20-4d67-b0ec-c75b2bb20610 with Priority: HIGHEST for action security_group_members [ 747.979769] env[70392]: INFO networking_nsxv3.common.synchronization [req-ec5f571c-b681-4011-a917-068841312893 req-65f2af66-7738-478f-b0fe-30b59ea1c761 service nova] Enqueued Resource ID: aed1fbdc-e1dd-470f-b2cb-80855c0346b5 with Priority: HIGHEST for action port [ 747.980395] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d79a9e34-ff20-4d67-b0ec-c75b2bb20610 with Priority: HIGHEST for action security_group_rules [ 747.980665] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d79a9e34-ff20-4d67-b0ec-c75b2bb20610 with Priority: HIGHEST for action security_group_members [ 747.980706] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aed1fbdc-e1dd-470f-b2cb-80855c0346b5 with Priority: HIGHEST for action port [ 747.982857] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d79a9e34-ff20-4d67-b0ec-c75b2bb20610 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.983065] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d79a9e34-ff20-4d67-b0ec-c75b2bb20610" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.983170] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d79a9e34-ff20-4d67-b0ec-c75b2bb20610" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.983493] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d79a9e34-ff20-4d67-b0ec-c75b2bb20610" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.983584] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d79a9e34-ff20-4d67-b0ec-c75b2bb20610',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.984547] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-d79a9e34-ff20-4d67-b0ec-c75b2bb20610 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.984715] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d79a9e34-ff20-4d67-b0ec-c75b2bb20610" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.984766] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d79a9e34-ff20-4d67-b0ec-c75b2bb20610" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.984932] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d79a9e34-ff20-4d67-b0ec-c75b2bb20610" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.985115] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.985214] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.985276] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.985465] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.985553] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.985660] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d79a9e34-ff20-4d67-b0ec-c75b2bb20610',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.988717] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-aed1fbdc-e1dd-470f-b2cb-80855c0346b5 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.988852] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aed1fbdc-e1dd-470f-b2cb-80855c0346b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.988938] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aed1fbdc-e1dd-470f-b2cb-80855c0346b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.989226] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aed1fbdc-e1dd-470f-b2cb-80855c0346b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.989311] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aed1fbdc-e1dd-470f-b2cb-80855c0346b5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.133192] env[70392]: INFO networking_nsxv3.common.synchronization [None req-a55f4870-4f2f-4806-aa80-677434d8e5e2 None None] Enqueued Resource ID: e5de30ad-4463-495f-9286-c363cb725867 with Priority: HIGHEST for action port [ 748.133904] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5de30ad-4463-495f-9286-c363cb725867 with Priority: HIGHEST for action port [ 748.134185] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-e5de30ad-4463-495f-9286-c363cb725867 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.134298] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e5de30ad-4463-495f-9286-c363cb725867" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.134370] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e5de30ad-4463-495f-9286-c363cb725867" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.134635] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e5de30ad-4463-495f-9286-c363cb725867" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.134718] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5de30ad-4463-495f-9286-c363cb725867',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.261361] env[70392]: INFO networking_nsxv3.common.synchronization [None req-420abc95-a67e-4e06-8640-5c306ddbaddc None None] Enqueued Resource ID: c3baa6dd-ea3f-4425-8d3a-42ccaf039e44 with Priority: HIGHEST for action port [ 748.261648] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3baa6dd-ea3f-4425-8d3a-42ccaf039e44 with Priority: HIGHEST for action port [ 748.263019] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-c3baa6dd-ea3f-4425-8d3a-42ccaf039e44 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.263205] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c3baa6dd-ea3f-4425-8d3a-42ccaf039e44" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.263325] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c3baa6dd-ea3f-4425-8d3a-42ccaf039e44" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.263728] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c3baa6dd-ea3f-4425-8d3a-42ccaf039e44" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.264130] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3baa6dd-ea3f-4425-8d3a-42ccaf039e44',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.491595] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-d79a9e34-ff20-4d67-b0ec-c75b2bb20610 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.491736] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d79a9e34-ff20-4d67-b0ec-c75b2bb20610" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.491936] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d79a9e34-ff20-4d67-b0ec-c75b2bb20610',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.493598] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aed1fbdc-e1dd-470f-b2cb-80855c0346b5 with status ACTIVE [ 748.493793] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.493930] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.494041] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.494313] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.494413] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.494593] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.494692] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.494755] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.495263] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.495263] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.495263] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.495452] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.495526] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.495693] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.495833] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.495877] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aed1fbdc-e1dd-470f-b2cb-80855c0346b5 is going to be updated. [ 748.517422] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.517580] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.517654] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.517856] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.518043] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.520986] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aed1fbdc-e1dd-470f-b2cb-80855c0346b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.637215] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e5de30ad-4463-495f-9286-c363cb725867 [ 748.637215] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.637215] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.637363] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.640204] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.640204] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.640204] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e5de30ad-4463-495f-9286-c363cb725867 already deleted. [ 748.640204] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e5de30ad-4463-495f-9286-c363cb725867" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.766697] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c3baa6dd-ea3f-4425-8d3a-42ccaf039e44 [ 748.771936] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.771936] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.771936] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.772259] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.772426] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.773074] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c3baa6dd-ea3f-4425-8d3a-42ccaf039e44 already deleted. [ 748.773721] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c3baa6dd-ea3f-4425-8d3a-42ccaf039e44" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.998856] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d79a9e34-ff20-4d67-b0ec-c75b2bb20610',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.310541] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac589e4e-a2e5-4716-8490-eecefc1b6a5e in Status: SUCCESS [ 749.311290] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac589e4e-a2e5-4716-8490-eecefc1b6a5e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.311290] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac589e4e-a2e5-4716-8490-eecefc1b6a5e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.311290] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac589e4e-a2e5-4716-8490-eecefc1b6a5e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.311500] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.311631] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.311631] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.311891] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.311891] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.312450] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac589e4e-a2e5-4716-8490-eecefc1b6a5e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.312450] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ac589e4e-a2e5-4716-8490-eecefc1b6a5e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.504103] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.504376] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.504529] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.505020] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.505123] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.505233] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d79a9e34-ff20-4d67-b0ec-c75b2bb20610 is going to be created. [ 749.531943] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.532206] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.532295] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.532558] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.532689] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.544328] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d79a9e34-ff20-4d67-b0ec-c75b2bb20610 in Status: UNINITIALIZED for 2s [ 749.816633] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ac589e4e-a2e5-4716-8490-eecefc1b6a5e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.320897] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ac589e4e-a2e5-4716-8490-eecefc1b6a5e: rpc.has_security_group_logging(os_id): False [ 750.339984] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.340198] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.340258] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.340445] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.340540] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.341120] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.341120] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.341120] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.341377] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.341377] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.341377] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac589e4e-a2e5-4716-8490-eecefc1b6a5e is going to be created. [ 750.407094] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.407328] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.407328] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.408954] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.408954] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.420033] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac589e4e-a2e5-4716-8490-eecefc1b6a5e in Status: IN_PROGRESS for 2s [ 751.097412] env[70392]: INFO networking_nsxv3.common.synchronization [req-af73ab6b-e7f4-49d7-a2b9-7b3ec6203f3b req-365a294d-987f-40f2-bca7-b12a79e684e9 tempest-DeleteServersAdminTestJSON-896255795 tempest-DeleteServersAdminTestJSON-896255795-project-member] Enqueued Resource ID: f0999f45-c89f-488f-b038-36a93b2cdeb4 with Priority: HIGHEST for action security_group_members [ 751.098096] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0999f45-c89f-488f-b038-36a93b2cdeb4 with Priority: HIGHEST for action security_group_members [ 751.098489] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0999f45-c89f-488f-b038-36a93b2cdeb4 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.098640] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0999f45-c89f-488f-b038-36a93b2cdeb4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.098714] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0999f45-c89f-488f-b038-36a93b2cdeb4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.098928] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0999f45-c89f-488f-b038-36a93b2cdeb4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.099174] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.099276] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.099337] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.099579] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.099630] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.099688] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0999f45-c89f-488f-b038-36a93b2cdeb4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.559511] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d79a9e34-ff20-4d67-b0ec-c75b2bb20610 in Status: SUCCESS [ 751.559511] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d79a9e34-ff20-4d67-b0ec-c75b2bb20610" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.559511] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d79a9e34-ff20-4d67-b0ec-c75b2bb20610" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.559511] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d79a9e34-ff20-4d67-b0ec-c75b2bb20610" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.559511] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.559511] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.559511] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.559511] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.559511] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.559511] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d79a9e34-ff20-4d67-b0ec-c75b2bb20610" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.559511] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d79a9e34-ff20-4d67-b0ec-c75b2bb20610',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.604590] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.604857] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.605215] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.605448] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.605607] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.605842] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.606492] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.606693] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.607127] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.607693] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.607693] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0999f45-c89f-488f-b038-36a93b2cdeb4 is going to be updated. [ 751.645323] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.645732] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.645858] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.646736] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.646912] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.658934] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0999f45-c89f-488f-b038-36a93b2cdeb4 in Status: IN_PROGRESS for 2s [ 751.801122] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-325 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.801382] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-325" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.801548] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-325" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.803839] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-325" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.804210] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.804386] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.804544] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.804841] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.805067] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.805524] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 751.805524] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 751.805651] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 751.805856] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 751.805995] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 751.806183] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 751.806364] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 751.827177] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 751.827393] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 751.827706] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 751.827841] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-325" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.828290] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-952f9e61-dc19-44b9-8163-0c9784e19494 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.828547] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-952f9e61-dc19-44b9-8163-0c9784e19494" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.828685] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-952f9e61-dc19-44b9-8163-0c9784e19494" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.829301] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-952f9e61-dc19-44b9-8163-0c9784e19494" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.829509] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('952f9e61-dc19-44b9-8163-0c9784e19494',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.061348] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-d79a9e34-ff20-4d67-b0ec-c75b2bb20610 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.061556] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d79a9e34-ff20-4d67-b0ec-c75b2bb20610" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.061603] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d79a9e34-ff20-4d67-b0ec-c75b2bb20610" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.061814] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d79a9e34-ff20-4d67-b0ec-c75b2bb20610" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.061990] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.062129] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.062196] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.062366] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.062458] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.062550] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d79a9e34-ff20-4d67-b0ec-c75b2bb20610" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.062699] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-d79a9e34-ff20-4d67-b0ec-c75b2bb20610 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.062793] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d79a9e34-ff20-4d67-b0ec-c75b2bb20610" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.062865] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d79a9e34-ff20-4d67-b0ec-c75b2bb20610" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.063020] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d79a9e34-ff20-4d67-b0ec-c75b2bb20610" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.063161] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.063268] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.063328] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.063471] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.063746] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.063746] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d79a9e34-ff20-4d67-b0ec-c75b2bb20610" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.063746] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d79a9e34-ff20-4d67-b0ec-c75b2bb20610',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.331839] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.332093] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.332342] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.333479] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.333479] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.333479] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 952f9e61-dc19-44b9-8163-0c9784e19494 not found, creating... [ 752.333479] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.333479] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.333479] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.333951] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.333951] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.334247] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.334392] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.334458] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.334642] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.334778] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.334964] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 952f9e61-dc19-44b9-8163-0c9784e19494 is going to be created. [ 752.367408] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.367647] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.367777] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.368117] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.368391] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.368591] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-952f9e61-dc19-44b9-8163-0c9784e19494" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.457866] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac589e4e-a2e5-4716-8490-eecefc1b6a5e in Status: SUCCESS [ 752.457866] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac589e4e-a2e5-4716-8490-eecefc1b6a5e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.568402] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d79a9e34-ff20-4d67-b0ec-c75b2bb20610: rpc.has_security_group_logging(os_id): False [ 752.586748] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.586929] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.587016] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.587243] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.587432] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.587544] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.587640] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.587701] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.587850] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.587926] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.588141] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.588241] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.588298] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.588503] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.588503] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.588680] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.588772] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.588823] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.588964] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.593320] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.593470] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d79a9e34-ff20-4d67-b0ec-c75b2bb20610 is going to be created. [ 752.665034] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.665219] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.665267] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.665452] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.665630] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.680286] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d79a9e34-ff20-4d67-b0ec-c75b2bb20610 in Status: IN_PROGRESS for 2s [ 752.995164] env[70392]: INFO networking_nsxv3.common.synchronization [None req-94706852-0252-44ae-9a14-b6431aac354a None None] Enqueued Resource ID: 2bc069e2-7216-4c64-81b7-5f7aed4eb217 with Priority: HIGHEST for action port [ 752.995164] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bc069e2-7216-4c64-81b7-5f7aed4eb217 with Priority: HIGHEST for action port [ 752.995164] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-2bc069e2-7216-4c64-81b7-5f7aed4eb217 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.995164] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2bc069e2-7216-4c64-81b7-5f7aed4eb217" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.995164] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2bc069e2-7216-4c64-81b7-5f7aed4eb217" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.995611] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2bc069e2-7216-4c64-81b7-5f7aed4eb217" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.995698] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2bc069e2-7216-4c64-81b7-5f7aed4eb217',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.128515] env[70392]: INFO networking_nsxv3.common.synchronization [req-af73ab6b-e7f4-49d7-a2b9-7b3ec6203f3b req-98622134-dcce-4ed2-9728-8d74d7e4f15a service nova] Enqueued Resource ID: f0999f45-c89f-488f-b038-36a93b2cdeb4 with Priority: HIGHEST for action security_group_rules [ 753.128690] env[70392]: INFO networking_nsxv3.common.synchronization [req-af73ab6b-e7f4-49d7-a2b9-7b3ec6203f3b req-98622134-dcce-4ed2-9728-8d74d7e4f15a service nova] Enqueued Resource ID: f0999f45-c89f-488f-b038-36a93b2cdeb4 with Priority: HIGHEST for action security_group_members [ 753.128829] env[70392]: INFO networking_nsxv3.common.synchronization [req-af73ab6b-e7f4-49d7-a2b9-7b3ec6203f3b req-98622134-dcce-4ed2-9728-8d74d7e4f15a service nova] Enqueued Resource ID: 952f9e61-dc19-44b9-8163-0c9784e19494 with Priority: HIGHEST for action port [ 753.129432] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0999f45-c89f-488f-b038-36a93b2cdeb4 with Priority: HIGHEST for action security_group_rules [ 753.129569] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0999f45-c89f-488f-b038-36a93b2cdeb4 with Priority: HIGHEST for action security_group_members [ 753.130118] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 952f9e61-dc19-44b9-8163-0c9784e19494 with Priority: HIGHEST for action port [ 753.130476] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f0999f45-c89f-488f-b038-36a93b2cdeb4 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.130476] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f0999f45-c89f-488f-b038-36a93b2cdeb4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.130640] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f0999f45-c89f-488f-b038-36a93b2cdeb4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.130852] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f0999f45-c89f-488f-b038-36a93b2cdeb4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.130980] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f0999f45-c89f-488f-b038-36a93b2cdeb4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.136913] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0999f45-c89f-488f-b038-36a93b2cdeb4 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.136913] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0999f45-c89f-488f-b038-36a93b2cdeb4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.136913] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-952f9e61-dc19-44b9-8163-0c9784e19494 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.136913] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-952f9e61-dc19-44b9-8163-0c9784e19494" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.136913] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-952f9e61-dc19-44b9-8163-0c9784e19494" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.136913] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-952f9e61-dc19-44b9-8163-0c9784e19494" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.136913] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('952f9e61-dc19-44b9-8163-0c9784e19494',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.499036] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2bc069e2-7216-4c64-81b7-5f7aed4eb217 [ 753.499329] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.500116] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.500116] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.500116] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.500116] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.500116] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2bc069e2-7216-4c64-81b7-5f7aed4eb217 already deleted. [ 753.500116] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2bc069e2-7216-4c64-81b7-5f7aed4eb217" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.637307] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0999f45-c89f-488f-b038-36a93b2cdeb4 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.637690] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0999f45-c89f-488f-b038-36a93b2cdeb4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.639882] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 952f9e61-dc19-44b9-8163-0c9784e19494 with status ACTIVE [ 753.640111] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.640226] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.640278] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.640530] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.640605] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.641492] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.641492] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.641492] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.641492] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.641492] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.641492] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.641492] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.641492] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.641848] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.641848] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.641848] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 952f9e61-dc19-44b9-8163-0c9784e19494 is going to be updated. [ 753.672975] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0999f45-c89f-488f-b038-36a93b2cdeb4 in Status: SUCCESS [ 753.673425] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0999f45-c89f-488f-b038-36a93b2cdeb4 deletion is rescheduled due to dependency. [ 753.673657] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0999f45-c89f-488f-b038-36a93b2cdeb4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.675673] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0999f45-c89f-488f-b038-36a93b2cdeb4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.675673] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0999f45-c89f-488f-b038-36a93b2cdeb4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.675673] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.675673] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.675673] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.675673] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.675673] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.675673] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0999f45-c89f-488f-b038-36a93b2cdeb4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.680071] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.680071] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.680071] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.680071] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.680071] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.680071] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-952f9e61-dc19-44b9-8163-0c9784e19494" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.059650] env[70392]: INFO networking_nsxv3.common.synchronization [req-f116415a-1d8a-4356-a15a-83bbdebf0b03 req-5cd91255-0235-4fb6-be96-80d1f716dd88 tempest-VolumesAdminNegativeTest-687729453 tempest-VolumesAdminNegativeTest-687729453-project-member] Enqueued Resource ID: 5142002e-26fc-486e-b9c2-236f95ba1fa4 with Priority: HIGHEST for action security_group_members [ 754.060500] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5142002e-26fc-486e-b9c2-236f95ba1fa4 with Priority: HIGHEST for action security_group_members [ 754.060851] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-5142002e-26fc-486e-b9c2-236f95ba1fa4 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.061105] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5142002e-26fc-486e-b9c2-236f95ba1fa4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.061105] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5142002e-26fc-486e-b9c2-236f95ba1fa4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.061371] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5142002e-26fc-486e-b9c2-236f95ba1fa4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.061501] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.061619] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.061677] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.061833] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.061919] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.062022] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5142002e-26fc-486e-b9c2-236f95ba1fa4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.179958] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f0999f45-c89f-488f-b038-36a93b2cdeb4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.565564] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.565762] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.566084] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.566225] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.566334] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.566602] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.566725] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.566778] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.566956] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.567057] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.567267] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5142002e-26fc-486e-b9c2-236f95ba1fa4 already deleted. [ 754.567267] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5142002e-26fc-486e-b9c2-236f95ba1fa4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.683855] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f0999f45-c89f-488f-b038-36a93b2cdeb4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.699316] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d79a9e34-ff20-4d67-b0ec-c75b2bb20610 in Status: SUCCESS [ 754.699571] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d79a9e34-ff20-4d67-b0ec-c75b2bb20610" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.730129] env[70392]: INFO networking_nsxv3.common.synchronization [req-096df810-85fb-43f1-899e-b86655f5959f req-7772f873-01c2-4831-af2b-8ddc60be9e6a tempest-AttachInterfacesV270Test-687848131 tempest-AttachInterfacesV270Test-687848131-project-member] Enqueued Resource ID: bc70a526-b91f-4303-b621-493cba506202 with Priority: HIGHEST for action security_group_members [ 754.730777] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc70a526-b91f-4303-b621-493cba506202 with Priority: HIGHEST for action security_group_members [ 754.731134] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc70a526-b91f-4303-b621-493cba506202 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.731273] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc70a526-b91f-4303-b621-493cba506202" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.731331] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc70a526-b91f-4303-b621-493cba506202" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.731685] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc70a526-b91f-4303-b621-493cba506202" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.731765] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.731843] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.731898] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.732032] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.732605] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.732605] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc70a526-b91f-4303-b621-493cba506202',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.813272] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-929 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.813272] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-929" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.813272] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-929" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.813272] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-929" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.813272] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.813272] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.813272] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.814591] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.816238] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.816238] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 754.816238] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 754.816238] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 754.816238] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 754.816238] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 754.816238] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 754.816238] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 754.837975] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 754.838122] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 754.838271] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 754.838619] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-929" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.838756] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-9159a78b-7765-4612-a8c9-26c0d9232149 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.838937] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-9159a78b-7765-4612-a8c9-26c0d9232149" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.839052] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-9159a78b-7765-4612-a8c9-26c0d9232149" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.839438] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-9159a78b-7765-4612-a8c9-26c0d9232149" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.839631] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9159a78b-7765-4612-a8c9-26c0d9232149',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.189032] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.189032] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.189032] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.189032] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.189032] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.189032] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0999f45-c89f-488f-b038-36a93b2cdeb4 is going to be updated. [ 755.219603] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.219744] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.219814] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.220050] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.220290] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.230920] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0999f45-c89f-488f-b038-36a93b2cdeb4 in Status: IN_PROGRESS for 2s [ 755.234447] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.234572] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.234630] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.234828] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.234922] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.235645] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.235933] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.236136] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.237041] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.237041] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.237041] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc70a526-b91f-4303-b621-493cba506202 is going to be updated. [ 755.273352] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.273532] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.273616] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.274082] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.274561] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.283799] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc70a526-b91f-4303-b621-493cba506202 in Status: IN_PROGRESS for 2s [ 755.345034] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.345286] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.345454] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.345699] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.345852] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.346015] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 9159a78b-7765-4612-a8c9-26c0d9232149 not found, creating... [ 755.346326] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.346495] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.346615] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.346919] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.347089] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.347399] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.347570] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.347683] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.347902] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.348691] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.350413] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 9159a78b-7765-4612-a8c9-26c0d9232149 is going to be created. [ 755.373615] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.373794] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.376341] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.376698] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.376971] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.377266] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-9159a78b-7765-4612-a8c9-26c0d9232149" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.400125] env[70392]: INFO networking_nsxv3.common.synchronization [None req-e23b63da-9e88-4114-ad79-39b7652e4ad3 None None] Enqueued Resource ID: 40a1a21f-03a9-4e93-8380-276a3d990cbb with Priority: HIGHEST for action port [ 755.401205] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40a1a21f-03a9-4e93-8380-276a3d990cbb with Priority: HIGHEST for action port [ 755.401311] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-40a1a21f-03a9-4e93-8380-276a3d990cbb taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.401422] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-40a1a21f-03a9-4e93-8380-276a3d990cbb" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.401492] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-40a1a21f-03a9-4e93-8380-276a3d990cbb" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.401789] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-40a1a21f-03a9-4e93-8380-276a3d990cbb" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.401930] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40a1a21f-03a9-4e93-8380-276a3d990cbb',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.862453] env[70392]: INFO networking_nsxv3.common.synchronization [req-88724c1b-c54c-4d47-8034-4106127561f1 req-f8364bbb-9086-45b0-b260-6f4be44017b5 tempest-ServersAdminNegativeTestJSON-1845401423 tempest-ServersAdminNegativeTestJSON-1845401423-project-member] Enqueued Resource ID: 59adf132-72f4-4d43-847e-1af9bc3c6073 with Priority: HIGHEST for action security_group_members [ 755.863055] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59adf132-72f4-4d43-847e-1af9bc3c6073 with Priority: HIGHEST for action security_group_members [ 755.863367] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-59adf132-72f4-4d43-847e-1af9bc3c6073 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.863496] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59adf132-72f4-4d43-847e-1af9bc3c6073" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.863564] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59adf132-72f4-4d43-847e-1af9bc3c6073" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.863763] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59adf132-72f4-4d43-847e-1af9bc3c6073" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.863914] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.864015] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.864081] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.864228] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.864319] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.864437] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('59adf132-72f4-4d43-847e-1af9bc3c6073',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.910201] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 40a1a21f-03a9-4e93-8380-276a3d990cbb [ 755.910201] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.910201] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.910201] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.910201] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.910201] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.910201] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:40a1a21f-03a9-4e93-8380-276a3d990cbb already deleted. [ 755.910201] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-40a1a21f-03a9-4e93-8380-276a3d990cbb" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.368551] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('59adf132-72f4-4d43-847e-1af9bc3c6073',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.870994] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('59adf132-72f4-4d43-847e-1af9bc3c6073',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.886882] env[70392]: INFO networking_nsxv3.common.synchronization [None req-44a1ee35-92b4-4e24-98d9-03dcb1405308 None None] Enqueued Resource ID: 87d6f05d-20ec-4de8-811b-406c49726880 with Priority: HIGHEST for action port [ 756.887423] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87d6f05d-20ec-4de8-811b-406c49726880 with Priority: HIGHEST for action port [ 756.887941] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-87d6f05d-20ec-4de8-811b-406c49726880 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.888086] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-87d6f05d-20ec-4de8-811b-406c49726880" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.888147] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-87d6f05d-20ec-4de8-811b-406c49726880" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.888446] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-87d6f05d-20ec-4de8-811b-406c49726880" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.888574] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('87d6f05d-20ec-4de8-811b-406c49726880',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.904820] env[70392]: INFO networking_nsxv3.common.synchronization [req-f116415a-1d8a-4356-a15a-83bbdebf0b03 req-c6258187-c48d-4057-a249-bc0f2bee7eda service nova] Enqueued Resource ID: 5142002e-26fc-486e-b9c2-236f95ba1fa4 with Priority: HIGHEST for action security_group_rules [ 756.905052] env[70392]: INFO networking_nsxv3.common.synchronization [req-f116415a-1d8a-4356-a15a-83bbdebf0b03 req-c6258187-c48d-4057-a249-bc0f2bee7eda service nova] Enqueued Resource ID: 5142002e-26fc-486e-b9c2-236f95ba1fa4 with Priority: HIGHEST for action security_group_members [ 756.905265] env[70392]: INFO networking_nsxv3.common.synchronization [req-f116415a-1d8a-4356-a15a-83bbdebf0b03 req-c6258187-c48d-4057-a249-bc0f2bee7eda service nova] Enqueued Resource ID: 9159a78b-7765-4612-a8c9-26c0d9232149 with Priority: HIGHEST for action port [ 756.905589] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5142002e-26fc-486e-b9c2-236f95ba1fa4 with Priority: HIGHEST for action security_group_rules [ 756.905752] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5142002e-26fc-486e-b9c2-236f95ba1fa4 with Priority: HIGHEST for action security_group_members [ 756.905923] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9159a78b-7765-4612-a8c9-26c0d9232149 with Priority: HIGHEST for action port [ 756.906726] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5142002e-26fc-486e-b9c2-236f95ba1fa4 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.906726] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5142002e-26fc-486e-b9c2-236f95ba1fa4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.906726] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5142002e-26fc-486e-b9c2-236f95ba1fa4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.907156] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5142002e-26fc-486e-b9c2-236f95ba1fa4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.907156] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5142002e-26fc-486e-b9c2-236f95ba1fa4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.909317] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-5142002e-26fc-486e-b9c2-236f95ba1fa4 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.909317] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5142002e-26fc-486e-b9c2-236f95ba1fa4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.909317] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5142002e-26fc-486e-b9c2-236f95ba1fa4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.909317] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5142002e-26fc-486e-b9c2-236f95ba1fa4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.909317] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.909317] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.909317] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.909796] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.909796] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.909796] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5142002e-26fc-486e-b9c2-236f95ba1fa4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.910443] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-9159a78b-7765-4612-a8c9-26c0d9232149 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.910614] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9159a78b-7765-4612-a8c9-26c0d9232149" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.910614] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9159a78b-7765-4612-a8c9-26c0d9232149" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.910778] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9159a78b-7765-4612-a8c9-26c0d9232149" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.910856] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9159a78b-7765-4612-a8c9-26c0d9232149',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.247367] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0999f45-c89f-488f-b038-36a93b2cdeb4 in Status: SUCCESS [ 757.247367] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0999f45-c89f-488f-b038-36a93b2cdeb4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.247892] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0999f45-c89f-488f-b038-36a93b2cdeb4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.252969] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0999f45-c89f-488f-b038-36a93b2cdeb4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.252969] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.252969] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.252969] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.252969] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.252969] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.252969] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0999f45-c89f-488f-b038-36a93b2cdeb4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.252969] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f0999f45-c89f-488f-b038-36a93b2cdeb4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.296249] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc70a526-b91f-4303-b621-493cba506202 in Status: SUCCESS [ 757.296431] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc70a526-b91f-4303-b621-493cba506202 deletion is rescheduled due to dependency. [ 757.296566] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc70a526-b91f-4303-b621-493cba506202" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.373431] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.373431] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.373431] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.373431] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.373431] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.374942] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59adf132-72f4-4d43-847e-1af9bc3c6073 is going to be updated. [ 757.391771] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 87d6f05d-20ec-4de8-811b-406c49726880 [ 757.392527] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.393106] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.394513] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.394513] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.394513] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.394947] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:87d6f05d-20ec-4de8-811b-406c49726880 already deleted. [ 757.394947] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-87d6f05d-20ec-4de8-811b-406c49726880" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.409326] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-5142002e-26fc-486e-b9c2-236f95ba1fa4 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.409651] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5142002e-26fc-486e-b9c2-236f95ba1fa4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.416190] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9159a78b-7765-4612-a8c9-26c0d9232149 with status ACTIVE [ 757.419050] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.419050] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.419050] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.419050] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.419050] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.419050] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.419050] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.419050] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.419050] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.419050] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.419050] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.419050] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.419050] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.419050] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.419050] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.419050] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9159a78b-7765-4612-a8c9-26c0d9232149 is going to be updated. [ 757.421449] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5142002e-26fc-486e-b9c2-236f95ba1fa4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.432511] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.432717] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.432717] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.432949] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.433113] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.447807] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59adf132-72f4-4d43-847e-1af9bc3c6073 in Status: IN_PROGRESS for 2s [ 757.452515] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.452655] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.452726] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.452944] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.453100] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.453296] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9159a78b-7765-4612-a8c9-26c0d9232149" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.757473] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0999f45-c89f-488f-b038-36a93b2cdeb4 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.757473] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0999f45-c89f-488f-b038-36a93b2cdeb4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.757473] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0999f45-c89f-488f-b038-36a93b2cdeb4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.757473] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0999f45-c89f-488f-b038-36a93b2cdeb4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.757473] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.757473] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.757473] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.757844] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.757844] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.757844] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0999f45-c89f-488f-b038-36a93b2cdeb4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.757985] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0999f45-c89f-488f-b038-36a93b2cdeb4 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.758054] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0999f45-c89f-488f-b038-36a93b2cdeb4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.758607] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0999f45-c89f-488f-b038-36a93b2cdeb4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.758607] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0999f45-c89f-488f-b038-36a93b2cdeb4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.758607] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.758607] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.758607] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.758951] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.758951] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.758951] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0999f45-c89f-488f-b038-36a93b2cdeb4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.758951] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f0999f45-c89f-488f-b038-36a93b2cdeb4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.925750] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5142002e-26fc-486e-b9c2-236f95ba1fa4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.265250] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f0999f45-c89f-488f-b038-36a93b2cdeb4: rpc.has_security_group_logging(os_id): False [ 758.282671] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.282842] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.282913] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.283182] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.283280] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.283491] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.283592] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.283649] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.283806] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.283884] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.284088] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.284184] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.284246] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.284388] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.284461] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.284654] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.284738] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.284798] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.284930] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.285009] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.286408] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f0999f45-c89f-488f-b038-36a93b2cdeb4 is going to be updated. [ 758.366168] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.367335] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.367420] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.367623] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.367770] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.382639] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f0999f45-c89f-488f-b038-36a93b2cdeb4 in Status: IN_PROGRESS for 2s [ 758.427550] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.427550] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.427550] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.427806] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.427806] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.427921] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5142002e-26fc-486e-b9c2-236f95ba1fa4 is going to be created. [ 758.474548] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.474703] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.474772] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.474991] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.475173] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.485899] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5142002e-26fc-486e-b9c2-236f95ba1fa4 in Status: UNINITIALIZED for 2s [ 759.462371] env[70392]: INFO networking_nsxv3.common.synchronization [None req-2a4e15c8-3142-445a-a2ea-04a41a9ce74f None None] Enqueued Resource ID: abef7778-5cb8-4837-9b42-1c904ce2b8bd with Priority: HIGHEST for action port [ 759.466142] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59adf132-72f4-4d43-847e-1af9bc3c6073 in Status: SUCCESS [ 759.466389] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59adf132-72f4-4d43-847e-1af9bc3c6073" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.469909] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abef7778-5cb8-4837-9b42-1c904ce2b8bd with Priority: HIGHEST for action port [ 759.469909] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-abef7778-5cb8-4837-9b42-1c904ce2b8bd taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.469909] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-abef7778-5cb8-4837-9b42-1c904ce2b8bd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.469909] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-abef7778-5cb8-4837-9b42-1c904ce2b8bd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.469909] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-abef7778-5cb8-4837-9b42-1c904ce2b8bd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.469909] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('abef7778-5cb8-4837-9b42-1c904ce2b8bd',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.806845] env[70392]: INFO networking_nsxv3.common.synchronization [None req-518443ca-b59d-4ddf-ac75-d7a247d624d7 None None] Enqueued Resource ID: 939c1347-3f2f-435c-a9ba-f14632bd1555 with Priority: HIGHEST for action port [ 759.807203] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 939c1347-3f2f-435c-a9ba-f14632bd1555 with Priority: HIGHEST for action port [ 759.807891] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-939c1347-3f2f-435c-a9ba-f14632bd1555 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.808022] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-939c1347-3f2f-435c-a9ba-f14632bd1555" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.808089] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-939c1347-3f2f-435c-a9ba-f14632bd1555" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.808450] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-939c1347-3f2f-435c-a9ba-f14632bd1555" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.808577] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('939c1347-3f2f-435c-a9ba-f14632bd1555',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.972144] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port abef7778-5cb8-4837-9b42-1c904ce2b8bd [ 759.972393] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.972581] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.972776] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.972946] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.973080] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.973237] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:abef7778-5cb8-4837-9b42-1c904ce2b8bd already deleted. [ 759.973349] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-abef7778-5cb8-4837-9b42-1c904ce2b8bd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.311448] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 939c1347-3f2f-435c-a9ba-f14632bd1555 [ 760.311448] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.311448] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.311448] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.311779] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.311779] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.311779] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:939c1347-3f2f-435c-a9ba-f14632bd1555 already deleted. [ 760.311779] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-939c1347-3f2f-435c-a9ba-f14632bd1555" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.335729] env[70392]: INFO networking_nsxv3.common.synchronization [req-ad11ca18-a5ee-4773-b6a1-8a041e867d2d req-d3d88c10-2c92-4f6f-8530-2de63c2946e6 tempest-AttachInterfacesTestJSON-2046649887 tempest-AttachInterfacesTestJSON-2046649887-project-member] Enqueued Resource ID: c1385665-0c09-423f-98c4-4d6b46c66ec0 with Priority: HIGHEST for action security_group_members [ 760.340236] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1385665-0c09-423f-98c4-4d6b46c66ec0 with Priority: HIGHEST for action security_group_members [ 760.340796] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1385665-0c09-423f-98c4-4d6b46c66ec0 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.341708] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1385665-0c09-423f-98c4-4d6b46c66ec0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.341708] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1385665-0c09-423f-98c4-4d6b46c66ec0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.341708] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1385665-0c09-423f-98c4-4d6b46c66ec0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.341708] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.341708] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.342752] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.342752] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.342752] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.342752] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c1385665-0c09-423f-98c4-4d6b46c66ec0',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.401324] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f0999f45-c89f-488f-b038-36a93b2cdeb4 in Status: SUCCESS [ 760.401744] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f0999f45-c89f-488f-b038-36a93b2cdeb4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.497616] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5142002e-26fc-486e-b9c2-236f95ba1fa4 in Status: SUCCESS [ 760.498019] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5142002e-26fc-486e-b9c2-236f95ba1fa4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.498019] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5142002e-26fc-486e-b9c2-236f95ba1fa4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.498253] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5142002e-26fc-486e-b9c2-236f95ba1fa4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.498458] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.498579] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.498642] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.498806] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.498939] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.498977] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5142002e-26fc-486e-b9c2-236f95ba1fa4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.499088] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5142002e-26fc-486e-b9c2-236f95ba1fa4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.847542] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.847542] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.847542] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.847542] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.847542] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.847542] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.847542] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.847542] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.847542] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.847542] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.847542] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1385665-0c09-423f-98c4-4d6b46c66ec0 already deleted. [ 760.847542] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1385665-0c09-423f-98c4-4d6b46c66ec0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.001024] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5142002e-26fc-486e-b9c2-236f95ba1fa4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.505228] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5142002e-26fc-486e-b9c2-236f95ba1fa4: rpc.has_security_group_logging(os_id): False [ 761.526091] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.526581] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.526581] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.526772] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.526772] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.527059] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.527213] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.527284] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.527498] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.527602] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.527711] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5142002e-26fc-486e-b9c2-236f95ba1fa4 is going to be created. [ 761.597011] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.597188] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.597238] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.597459] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.597818] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.613703] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5142002e-26fc-486e-b9c2-236f95ba1fa4 in Status: IN_PROGRESS for 2s [ 761.684639] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-328 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.684849] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.684973] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.685367] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.685646] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.685808] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.685924] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.687582] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.688075] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.688075] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 761.688213] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 761.688253] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 761.688463] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 761.688532] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 761.688694] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 761.688759] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 761.713204] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 761.713375] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 761.713555] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 761.713705] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.714078] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-b1bb75b0-d81f-47c2-be54-3ba0161e9409 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.714325] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-b1bb75b0-d81f-47c2-be54-3ba0161e9409" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.714402] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-b1bb75b0-d81f-47c2-be54-3ba0161e9409" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.714739] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-b1bb75b0-d81f-47c2-be54-3ba0161e9409" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.714885] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1bb75b0-d81f-47c2-be54-3ba0161e9409',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.218481] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.219024] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.219133] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.219566] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.219795] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.220534] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port b1bb75b0-d81f-47c2-be54-3ba0161e9409 not found, creating... [ 762.220534] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.221012] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.221012] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.221306] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.221519] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.222063] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.222205] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.222419] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.222809] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.222906] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.223131] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: b1bb75b0-d81f-47c2-be54-3ba0161e9409 is going to be created. [ 762.251040] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.251390] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.251533] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.251974] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.252338] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.253505] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-b1bb75b0-d81f-47c2-be54-3ba0161e9409" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.565028] env[70392]: INFO networking_nsxv3.common.synchronization [None req-ed179ff3-a335-4cfb-929e-48fdac9852a0 None None] Enqueued Resource ID: 79c7ac34-76f9-4251-b56a-38667a4d7d3e with Priority: HIGHEST for action port [ 762.565028] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79c7ac34-76f9-4251-b56a-38667a4d7d3e with Priority: HIGHEST for action port [ 762.565028] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-79c7ac34-76f9-4251-b56a-38667a4d7d3e taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.565028] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-79c7ac34-76f9-4251-b56a-38667a4d7d3e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.565028] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-79c7ac34-76f9-4251-b56a-38667a4d7d3e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.565028] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-79c7ac34-76f9-4251-b56a-38667a4d7d3e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.565028] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79c7ac34-76f9-4251-b56a-38667a4d7d3e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.843642] env[70392]: INFO networking_nsxv3.common.synchronization [None req-5c4a4fcd-5e6d-4b49-9b30-94703f6d06ea None None] Enqueued Resource ID: 9ff809d8-804b-48ee-98e5-6c97a4c4f7ad with Priority: HIGHEST for action port [ 762.843642] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ff809d8-804b-48ee-98e5-6c97a4c4f7ad with Priority: HIGHEST for action port [ 762.843840] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-9ff809d8-804b-48ee-98e5-6c97a4c4f7ad taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.843975] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9ff809d8-804b-48ee-98e5-6c97a4c4f7ad" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.844102] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9ff809d8-804b-48ee-98e5-6c97a4c4f7ad" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.844333] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9ff809d8-804b-48ee-98e5-6c97a4c4f7ad" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.844423] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ff809d8-804b-48ee-98e5-6c97a4c4f7ad',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.053846] env[70392]: INFO networking_nsxv3.common.synchronization [None req-35a8395c-f3c7-4930-9561-4bfff868231d None None] Enqueued Resource ID: c852c3b6-2453-4dfc-8a2f-8f2f4e10ff88 with Priority: HIGHEST for action port [ 763.054175] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c852c3b6-2453-4dfc-8a2f-8f2f4e10ff88 with Priority: HIGHEST for action port [ 763.054822] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-c852c3b6-2453-4dfc-8a2f-8f2f4e10ff88 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.054953] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c852c3b6-2453-4dfc-8a2f-8f2f4e10ff88" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.058264] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c852c3b6-2453-4dfc-8a2f-8f2f4e10ff88" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.058813] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c852c3b6-2453-4dfc-8a2f-8f2f4e10ff88" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.058813] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c852c3b6-2453-4dfc-8a2f-8f2f4e10ff88',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.069910] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 79c7ac34-76f9-4251-b56a-38667a4d7d3e [ 763.070614] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.070743] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.071256] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.071374] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.071472] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.071578] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:79c7ac34-76f9-4251-b56a-38667a4d7d3e already deleted. [ 763.071799] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-79c7ac34-76f9-4251-b56a-38667a4d7d3e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.150240] env[70392]: INFO networking_nsxv3.common.synchronization [None req-eeae8f6f-8ec1-41cc-9a3a-61fb07c3575c None None] Enqueued Resource ID: 2b8a5842-62db-4785-bf80-57378723fb0d with Priority: HIGHEST for action port [ 763.153036] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b8a5842-62db-4785-bf80-57378723fb0d with Priority: HIGHEST for action port [ 763.153697] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-2b8a5842-62db-4785-bf80-57378723fb0d taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.153819] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2b8a5842-62db-4785-bf80-57378723fb0d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.153867] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2b8a5842-62db-4785-bf80-57378723fb0d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.158037] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2b8a5842-62db-4785-bf80-57378723fb0d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.158037] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b8a5842-62db-4785-bf80-57378723fb0d',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.347421] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9ff809d8-804b-48ee-98e5-6c97a4c4f7ad [ 763.347674] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.347810] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.347878] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.348133] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.348232] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.348439] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9ff809d8-804b-48ee-98e5-6c97a4c4f7ad already deleted. [ 763.348536] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9ff809d8-804b-48ee-98e5-6c97a4c4f7ad" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.422663] env[70392]: INFO networking_nsxv3.common.synchronization [req-ad11ca18-a5ee-4773-b6a1-8a041e867d2d req-f20faf15-03f6-40a1-ad82-ed3ab496b9de service nova] Enqueued Resource ID: c1385665-0c09-423f-98c4-4d6b46c66ec0 with Priority: HIGHEST for action security_group_rules [ 763.422857] env[70392]: INFO networking_nsxv3.common.synchronization [req-ad11ca18-a5ee-4773-b6a1-8a041e867d2d req-f20faf15-03f6-40a1-ad82-ed3ab496b9de service nova] Enqueued Resource ID: c1385665-0c09-423f-98c4-4d6b46c66ec0 with Priority: HIGHEST for action security_group_members [ 763.423023] env[70392]: INFO networking_nsxv3.common.synchronization [req-ad11ca18-a5ee-4773-b6a1-8a041e867d2d req-f20faf15-03f6-40a1-ad82-ed3ab496b9de service nova] Enqueued Resource ID: b1bb75b0-d81f-47c2-be54-3ba0161e9409 with Priority: HIGHEST for action port [ 763.423545] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1385665-0c09-423f-98c4-4d6b46c66ec0 with Priority: HIGHEST for action security_group_rules [ 763.423673] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1385665-0c09-423f-98c4-4d6b46c66ec0 with Priority: HIGHEST for action security_group_members [ 763.423769] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1bb75b0-d81f-47c2-be54-3ba0161e9409 with Priority: HIGHEST for action port [ 763.425307] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c1385665-0c09-423f-98c4-4d6b46c66ec0 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.425474] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c1385665-0c09-423f-98c4-4d6b46c66ec0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.425562] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c1385665-0c09-423f-98c4-4d6b46c66ec0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.425761] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c1385665-0c09-423f-98c4-4d6b46c66ec0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.425847] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c1385665-0c09-423f-98c4-4d6b46c66ec0',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.426748] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1385665-0c09-423f-98c4-4d6b46c66ec0 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.426855] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1385665-0c09-423f-98c4-4d6b46c66ec0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.426921] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1385665-0c09-423f-98c4-4d6b46c66ec0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.427111] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1385665-0c09-423f-98c4-4d6b46c66ec0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.427264] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.427383] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.427449] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.427599] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.427679] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.427772] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c1385665-0c09-423f-98c4-4d6b46c66ec0',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.428634] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-b1bb75b0-d81f-47c2-be54-3ba0161e9409 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.428742] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b1bb75b0-d81f-47c2-be54-3ba0161e9409" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.428803] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b1bb75b0-d81f-47c2-be54-3ba0161e9409" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.429924] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b1bb75b0-d81f-47c2-be54-3ba0161e9409" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.430038] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1bb75b0-d81f-47c2-be54-3ba0161e9409',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.561599] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c852c3b6-2453-4dfc-8a2f-8f2f4e10ff88 [ 763.562573] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.562573] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.562573] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.562573] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.562573] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.562573] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c852c3b6-2453-4dfc-8a2f-8f2f4e10ff88 already deleted. [ 763.562573] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c852c3b6-2453-4dfc-8a2f-8f2f4e10ff88" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.627083] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5142002e-26fc-486e-b9c2-236f95ba1fa4 in Status: SUCCESS [ 763.627426] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5142002e-26fc-486e-b9c2-236f95ba1fa4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.657018] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2b8a5842-62db-4785-bf80-57378723fb0d [ 763.657751] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.657751] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.657751] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.657751] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.658134] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.658134] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2b8a5842-62db-4785-bf80-57378723fb0d already deleted. [ 763.658134] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2b8a5842-62db-4785-bf80-57378723fb0d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.932271] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1385665-0c09-423f-98c4-4d6b46c66ec0 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.932431] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1385665-0c09-423f-98c4-4d6b46c66ec0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.933383] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c1385665-0c09-423f-98c4-4d6b46c66ec0',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.933665] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b1bb75b0-d81f-47c2-be54-3ba0161e9409 with status ACTIVE [ 763.933858] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.933973] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.934048] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.934412] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.934535] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.934730] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.934843] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.934919] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.935420] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.935611] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.935984] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.935984] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.936381] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.936381] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.936565] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.936662] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b1bb75b0-d81f-47c2-be54-3ba0161e9409 is going to be updated. [ 763.973964] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.974343] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.974343] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.977035] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.977035] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.977035] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b1bb75b0-d81f-47c2-be54-3ba0161e9409" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.043975] env[70392]: INFO networking_nsxv3.common.synchronization [req-2e34efd3-4789-431d-ad07-71d3e12d2351 req-799d566d-5881-436c-9509-86e69de8f444 tempest-SecurityGroupRulesNegativeTestJSON-1839941760 tempest-SecurityGroupRulesNegativeTestJSON-1839941760-project-member] Enqueued Resource ID: 066a81d0-e819-4529-acac-80bbef25e842 with Priority: HIGHEST for action security_group_rules [ 764.045255] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 066a81d0-e819-4529-acac-80bbef25e842 with Priority: HIGHEST for action security_group_rules [ 764.047394] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-066a81d0-e819-4529-acac-80bbef25e842 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.048203] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-066a81d0-e819-4529-acac-80bbef25e842" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.048203] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-066a81d0-e819-4529-acac-80bbef25e842" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.048203] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-066a81d0-e819-4529-acac-80bbef25e842" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.048203] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('066a81d0-e819-4529-acac-80bbef25e842',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.439491] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c1385665-0c09-423f-98c4-4d6b46c66ec0',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.572208] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.572449] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.572530] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.572765] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.572858] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.572981] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 066a81d0-e819-4529-acac-80bbef25e842 already deleted. [ 764.573456] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-066a81d0-e819-4529-acac-80bbef25e842" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.615427] env[70392]: INFO networking_nsxv3.common.synchronization [req-9756617a-c5ce-411f-868c-4da2d9e8dd02 req-bbecf5bb-7621-4f3f-b853-a298c55b17d5 tempest-ImagesOneServerNegativeTestJSON-1691594958 tempest-ImagesOneServerNegativeTestJSON-1691594958-project-member] Enqueued Resource ID: dbeb3b19-0a8e-4685-84e0-239c82418063 with Priority: HIGHEST for action security_group_members [ 764.615943] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbeb3b19-0a8e-4685-84e0-239c82418063 with Priority: HIGHEST for action security_group_members [ 764.616260] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbeb3b19-0a8e-4685-84e0-239c82418063 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.616391] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.616455] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.617837] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.618043] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.618160] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.618225] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.618501] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.618631] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.619549] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbeb3b19-0a8e-4685-84e0-239c82418063',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.948751] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.948751] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.948751] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.948751] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.948751] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.948751] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1385665-0c09-423f-98c4-4d6b46c66ec0 is going to be created. [ 764.975011] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.975011] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.975011] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.975011] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.975011] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.990666] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1385665-0c09-423f-98c4-4d6b46c66ec0 in Status: UNINITIALIZED for 2s [ 765.103294] env[70392]: INFO networking_nsxv3.common.synchronization [None req-e1b5ca33-85e9-45f3-b545-3450f937d48d None None] Enqueued Resource ID: 75529e4e-749d-4d7d-ad82-3ae46d3e8e3a with Priority: HIGHEST for action port [ 765.103557] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75529e4e-749d-4d7d-ad82-3ae46d3e8e3a with Priority: HIGHEST for action port [ 765.105198] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-75529e4e-749d-4d7d-ad82-3ae46d3e8e3a taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.105198] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-75529e4e-749d-4d7d-ad82-3ae46d3e8e3a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.105198] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-75529e4e-749d-4d7d-ad82-3ae46d3e8e3a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.105373] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-75529e4e-749d-4d7d-ad82-3ae46d3e8e3a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.105455] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75529e4e-749d-4d7d-ad82-3ae46d3e8e3a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.121896] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.122148] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.122224] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.122435] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.122533] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.122733] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.122832] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.122895] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.123062] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.123141] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.123873] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbeb3b19-0a8e-4685-84e0-239c82418063 is going to be updated. [ 765.155666] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.155834] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.155906] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.156852] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.157066] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.167278] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbeb3b19-0a8e-4685-84e0-239c82418063 in Status: IN_PROGRESS for 2s [ 765.610138] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 75529e4e-749d-4d7d-ad82-3ae46d3e8e3a [ 765.610948] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.612960] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.612960] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.612960] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.612960] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.612960] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:75529e4e-749d-4d7d-ad82-3ae46d3e8e3a already deleted. [ 765.612960] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-75529e4e-749d-4d7d-ad82-3ae46d3e8e3a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.009243] env[70392]: INFO networking_nsxv3.common.synchronization [req-bc92570f-a41c-48df-9440-2714317a2431 req-71470170-318b-403e-a1b3-4fda2f997f99 tempest-SecurityGroupRulesNegativeTestJSON-1839941760 tempest-SecurityGroupRulesNegativeTestJSON-1839941760-project-member] Enqueued Resource ID: 066a81d0-e819-4529-acac-80bbef25e842 with Priority: HIGHEST for action security_group_rules [ 766.009865] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 066a81d0-e819-4529-acac-80bbef25e842 with Priority: HIGHEST for action security_group_rules [ 766.010203] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-066a81d0-e819-4529-acac-80bbef25e842 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.010330] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-066a81d0-e819-4529-acac-80bbef25e842" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.010420] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-066a81d0-e819-4529-acac-80bbef25e842" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.010594] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-066a81d0-e819-4529-acac-80bbef25e842" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.010680] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('066a81d0-e819-4529-acac-80bbef25e842',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.533915] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.534933] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.534933] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.534933] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.534933] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.534933] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 066a81d0-e819-4529-acac-80bbef25e842 already deleted. [ 766.534933] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-066a81d0-e819-4529-acac-80bbef25e842" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.541160] env[70392]: INFO networking_nsxv3.common.synchronization [None req-ea8ddebd-68ca-4ade-9fdd-9e080efcc243 None None] Enqueued Resource ID: 3eee2068-8a16-4843-ab3d-3d2a9432b24a with Priority: HIGHEST for action port [ 766.545029] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3eee2068-8a16-4843-ab3d-3d2a9432b24a with Priority: HIGHEST for action port [ 766.545029] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-3eee2068-8a16-4843-ab3d-3d2a9432b24a taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.545029] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3eee2068-8a16-4843-ab3d-3d2a9432b24a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.545029] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3eee2068-8a16-4843-ab3d-3d2a9432b24a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.545029] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3eee2068-8a16-4843-ab3d-3d2a9432b24a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.545029] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3eee2068-8a16-4843-ab3d-3d2a9432b24a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.998320] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1385665-0c09-423f-98c4-4d6b46c66ec0 in Status: SUCCESS [ 766.999066] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1385665-0c09-423f-98c4-4d6b46c66ec0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.999066] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1385665-0c09-423f-98c4-4d6b46c66ec0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.999066] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1385665-0c09-423f-98c4-4d6b46c66ec0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.000016] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.000016] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.000016] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.000016] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.000016] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.000016] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1385665-0c09-423f-98c4-4d6b46c66ec0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.000016] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c1385665-0c09-423f-98c4-4d6b46c66ec0',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.045587] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3eee2068-8a16-4843-ab3d-3d2a9432b24a [ 767.046482] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.046606] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.046606] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.046789] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.046882] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.047040] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3eee2068-8a16-4843-ab3d-3d2a9432b24a already deleted. [ 767.050015] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3eee2068-8a16-4843-ab3d-3d2a9432b24a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.182892] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbeb3b19-0a8e-4685-84e0-239c82418063 in Status: SUCCESS [ 767.183175] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbeb3b19-0a8e-4685-84e0-239c82418063 deletion is rescheduled due to dependency. [ 767.183241] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.503209] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c1385665-0c09-423f-98c4-4d6b46c66ec0',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.517602] env[70392]: INFO networking_nsxv3.common.synchronization [None req-59e43aa6-77a3-4a21-8828-202693ddcf8b None None] Enqueued Resource ID: 9d967389-536a-4e13-8332-89032f084970 with Priority: HIGHEST for action port [ 767.517902] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d967389-536a-4e13-8332-89032f084970 with Priority: HIGHEST for action port [ 767.518720] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d967389-536a-4e13-8332-89032f084970 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.518849] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d967389-536a-4e13-8332-89032f084970" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.522038] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d967389-536a-4e13-8332-89032f084970" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.522038] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d967389-536a-4e13-8332-89032f084970" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.522038] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d967389-536a-4e13-8332-89032f084970',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.006565] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c1385665-0c09-423f-98c4-4d6b46c66ec0: rpc.has_security_group_logging(os_id): False [ 768.025026] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9d967389-536a-4e13-8332-89032f084970 [ 768.025026] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.025026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.025026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.025026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.025026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.025026] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9d967389-536a-4e13-8332-89032f084970 already deleted. [ 768.025026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d967389-536a-4e13-8332-89032f084970" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.028054] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.030497] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.030497] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.030497] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.030497] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.030497] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.030497] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.030497] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.030497] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.030497] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.030497] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c1385665-0c09-423f-98c4-4d6b46c66ec0 is going to be created. [ 768.104947] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.104947] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.104947] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.104947] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.104947] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.117467] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c1385665-0c09-423f-98c4-4d6b46c66ec0 in Status: IN_PROGRESS for 2s [ 768.138345] env[70392]: INFO networking_nsxv3.common.synchronization [req-7bf15b78-f8d7-47f0-b2d3-d7a5225cc8ad req-69852f40-f803-4193-99f1-e6fa54553c67 tempest-ServerRescueTestJSONUnderV235-1486079035 tempest-ServerRescueTestJSONUnderV235-1486079035-project-member] Enqueued Resource ID: d79a9e34-ff20-4d67-b0ec-c75b2bb20610 with Priority: HIGHEST for action security_group_members [ 768.138491] env[70392]: INFO networking_nsxv3.common.synchronization [req-7bf15b78-f8d7-47f0-b2d3-d7a5225cc8ad req-69852f40-f803-4193-99f1-e6fa54553c67 tempest-ServerRescueTestJSONUnderV235-1486079035 tempest-ServerRescueTestJSONUnderV235-1486079035-project-member] Enqueued Resource ID: 5429c224-badd-4df6-b72c-e9a34b52b264 with Priority: HIGHEST for action security_group_members [ 768.139400] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d79a9e34-ff20-4d67-b0ec-c75b2bb20610 with Priority: HIGHEST for action security_group_members [ 768.139565] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5429c224-badd-4df6-b72c-e9a34b52b264 with Priority: HIGHEST for action security_group_members [ 768.139859] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-d79a9e34-ff20-4d67-b0ec-c75b2bb20610 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.139986] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d79a9e34-ff20-4d67-b0ec-c75b2bb20610" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.140374] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d79a9e34-ff20-4d67-b0ec-c75b2bb20610" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.141634] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d79a9e34-ff20-4d67-b0ec-c75b2bb20610" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.141634] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.141634] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.141634] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.141937] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.142129] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.142281] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d79a9e34-ff20-4d67-b0ec-c75b2bb20610',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.145773] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-5429c224-badd-4df6-b72c-e9a34b52b264 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.145897] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5429c224-badd-4df6-b72c-e9a34b52b264" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.145965] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5429c224-badd-4df6-b72c-e9a34b52b264" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.146219] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5429c224-badd-4df6-b72c-e9a34b52b264" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.146385] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.146514] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.146550] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.146696] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.146785] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.146879] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5429c224-badd-4df6-b72c-e9a34b52b264',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.236942] env[70392]: INFO networking_nsxv3.common.synchronization [req-7bf15b78-f8d7-47f0-b2d3-d7a5225cc8ad req-69852f40-f803-4193-99f1-e6fa54553c67 tempest-ServerRescueTestJSONUnderV235-1486079035 tempest-ServerRescueTestJSONUnderV235-1486079035-project-member] Enqueued Resource ID: 5429c224-badd-4df6-b72c-e9a34b52b264 with Priority: HIGHEST for action security_group_rules [ 768.237313] env[70392]: INFO networking_nsxv3.common.synchronization [req-7bf15b78-f8d7-47f0-b2d3-d7a5225cc8ad req-69852f40-f803-4193-99f1-e6fa54553c67 tempest-ServerRescueTestJSONUnderV235-1486079035 tempest-ServerRescueTestJSONUnderV235-1486079035-project-member] Enqueued Resource ID: 5429c224-badd-4df6-b72c-e9a34b52b264 with Priority: HIGHEST for action security_group_members [ 768.237500] env[70392]: INFO networking_nsxv3.common.synchronization [req-7bf15b78-f8d7-47f0-b2d3-d7a5225cc8ad req-69852f40-f803-4193-99f1-e6fa54553c67 tempest-ServerRescueTestJSONUnderV235-1486079035 tempest-ServerRescueTestJSONUnderV235-1486079035-project-member] Enqueued Resource ID: d79a9e34-ff20-4d67-b0ec-c75b2bb20610 with Priority: HIGHEST for action security_group_rules [ 768.237663] env[70392]: INFO networking_nsxv3.common.synchronization [req-7bf15b78-f8d7-47f0-b2d3-d7a5225cc8ad req-69852f40-f803-4193-99f1-e6fa54553c67 tempest-ServerRescueTestJSONUnderV235-1486079035 tempest-ServerRescueTestJSONUnderV235-1486079035-project-member] Enqueued Resource ID: d79a9e34-ff20-4d67-b0ec-c75b2bb20610 with Priority: HIGHEST for action security_group_members [ 768.237766] env[70392]: INFO networking_nsxv3.common.synchronization [req-7bf15b78-f8d7-47f0-b2d3-d7a5225cc8ad req-69852f40-f803-4193-99f1-e6fa54553c67 tempest-ServerRescueTestJSONUnderV235-1486079035 tempest-ServerRescueTestJSONUnderV235-1486079035-project-member] Enqueued Resource ID: aed1fbdc-e1dd-470f-b2cb-80855c0346b5 with Priority: HIGHEST for action port [ 768.238475] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5429c224-badd-4df6-b72c-e9a34b52b264 with Priority: HIGHEST for action security_group_rules [ 768.238626] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d79a9e34-ff20-4d67-b0ec-c75b2bb20610 with Priority: HIGHEST for action security_group_rules [ 768.238748] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aed1fbdc-e1dd-470f-b2cb-80855c0346b5 with Priority: HIGHEST for action port [ 768.238843] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5429c224-badd-4df6-b72c-e9a34b52b264 with Priority: HIGHEST for action security_group_members [ 768.238930] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d79a9e34-ff20-4d67-b0ec-c75b2bb20610 with Priority: HIGHEST for action security_group_members [ 768.240829] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5429c224-badd-4df6-b72c-e9a34b52b264 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.241192] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5429c224-badd-4df6-b72c-e9a34b52b264" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.241192] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5429c224-badd-4df6-b72c-e9a34b52b264" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.241282] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5429c224-badd-4df6-b72c-e9a34b52b264" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.241367] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5429c224-badd-4df6-b72c-e9a34b52b264',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.242631] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d79a9e34-ff20-4d67-b0ec-c75b2bb20610 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.242631] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d79a9e34-ff20-4d67-b0ec-c75b2bb20610" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.242631] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d79a9e34-ff20-4d67-b0ec-c75b2bb20610" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.243815] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d79a9e34-ff20-4d67-b0ec-c75b2bb20610" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.243915] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d79a9e34-ff20-4d67-b0ec-c75b2bb20610',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.244882] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-aed1fbdc-e1dd-470f-b2cb-80855c0346b5 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.248322] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aed1fbdc-e1dd-470f-b2cb-80855c0346b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.248322] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aed1fbdc-e1dd-470f-b2cb-80855c0346b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.248322] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aed1fbdc-e1dd-470f-b2cb-80855c0346b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.248322] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aed1fbdc-e1dd-470f-b2cb-80855c0346b5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.248322] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-5429c224-badd-4df6-b72c-e9a34b52b264 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.248322] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5429c224-badd-4df6-b72c-e9a34b52b264" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.248322] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-d79a9e34-ff20-4d67-b0ec-c75b2bb20610 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.248322] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d79a9e34-ff20-4d67-b0ec-c75b2bb20610" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.647513] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d79a9e34-ff20-4d67-b0ec-c75b2bb20610',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.649668] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5429c224-badd-4df6-b72c-e9a34b52b264',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.748178] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-5429c224-badd-4df6-b72c-e9a34b52b264 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.749149] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5429c224-badd-4df6-b72c-e9a34b52b264" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.749353] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-d79a9e34-ff20-4d67-b0ec-c75b2bb20610 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.749501] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d79a9e34-ff20-4d67-b0ec-c75b2bb20610" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.750827] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aed1fbdc-e1dd-470f-b2cb-80855c0346b5 with status ACTIVE [ 768.751018] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.751139] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.751205] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.751423] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.751512] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.751684] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.751832] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.751832] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.752018] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.752705] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.752705] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.752705] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.752705] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.752705] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.752884] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.752884] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aed1fbdc-e1dd-470f-b2cb-80855c0346b5 is going to be updated. [ 768.777500] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.777672] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.777746] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.777909] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.778123] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.778349] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aed1fbdc-e1dd-470f-b2cb-80855c0346b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.079714] env[70392]: INFO networking_nsxv3.common.synchronization [req-88593abc-f9e0-4994-bca0-48b14868cc1d req-b24b346f-f762-4b3f-bc21-0de0a11d1c32 tempest-ServerRescueTestJSONUnderV235-1486079035 tempest-ServerRescueTestJSONUnderV235-1486079035-project-member] Enqueued Resource ID: d79a9e34-ff20-4d67-b0ec-c75b2bb20610 with Priority: HIGHEST for action security_group_members [ 769.079900] env[70392]: INFO networking_nsxv3.common.synchronization [req-88593abc-f9e0-4994-bca0-48b14868cc1d req-b24b346f-f762-4b3f-bc21-0de0a11d1c32 tempest-ServerRescueTestJSONUnderV235-1486079035 tempest-ServerRescueTestJSONUnderV235-1486079035-project-member] Enqueued Resource ID: 5429c224-badd-4df6-b72c-e9a34b52b264 with Priority: HIGHEST for action security_group_members [ 769.080522] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d79a9e34-ff20-4d67-b0ec-c75b2bb20610 with Priority: HIGHEST for action security_group_members [ 769.080684] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5429c224-badd-4df6-b72c-e9a34b52b264 with Priority: HIGHEST for action security_group_members [ 769.081038] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-d79a9e34-ff20-4d67-b0ec-c75b2bb20610 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.081096] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d79a9e34-ff20-4d67-b0ec-c75b2bb20610" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.081285] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-5429c224-badd-4df6-b72c-e9a34b52b264 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.081370] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5429c224-badd-4df6-b72c-e9a34b52b264" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.101759] env[70392]: INFO networking_nsxv3.common.synchronization [req-63d944dc-2545-4486-a1d5-c37b93553f8f req-73dc55da-551b-4839-9cb0-424c2cb153ee tempest-DeleteServersAdminTestJSON-896255795 tempest-DeleteServersAdminTestJSON-896255795-project-member] Enqueued Resource ID: f0999f45-c89f-488f-b038-36a93b2cdeb4 with Priority: HIGHEST for action security_group_members [ 769.102572] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0999f45-c89f-488f-b038-36a93b2cdeb4 with Priority: HIGHEST for action security_group_members [ 769.108611] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0999f45-c89f-488f-b038-36a93b2cdeb4 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.108921] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0999f45-c89f-488f-b038-36a93b2cdeb4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.108959] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0999f45-c89f-488f-b038-36a93b2cdeb4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.109313] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0999f45-c89f-488f-b038-36a93b2cdeb4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.109577] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.110591] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.110591] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.110591] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.110591] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.110591] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0999f45-c89f-488f-b038-36a93b2cdeb4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.151723] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d79a9e34-ff20-4d67-b0ec-c75b2bb20610',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.152983] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5429c224-badd-4df6-b72c-e9a34b52b264',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.170017] env[70392]: INFO networking_nsxv3.common.synchronization [req-88593abc-f9e0-4994-bca0-48b14868cc1d req-b24b346f-f762-4b3f-bc21-0de0a11d1c32 tempest-ServerRescueTestJSONUnderV235-1486079035 tempest-ServerRescueTestJSONUnderV235-1486079035-project-member] Enqueued Resource ID: d79a9e34-ff20-4d67-b0ec-c75b2bb20610 with Priority: HIGHEST for action security_group_rules [ 769.170146] env[70392]: INFO networking_nsxv3.common.synchronization [req-88593abc-f9e0-4994-bca0-48b14868cc1d req-b24b346f-f762-4b3f-bc21-0de0a11d1c32 tempest-ServerRescueTestJSONUnderV235-1486079035 tempest-ServerRescueTestJSONUnderV235-1486079035-project-member] Enqueued Resource ID: d79a9e34-ff20-4d67-b0ec-c75b2bb20610 with Priority: HIGHEST for action security_group_members [ 769.170236] env[70392]: INFO networking_nsxv3.common.synchronization [req-88593abc-f9e0-4994-bca0-48b14868cc1d req-b24b346f-f762-4b3f-bc21-0de0a11d1c32 tempest-ServerRescueTestJSONUnderV235-1486079035 tempest-ServerRescueTestJSONUnderV235-1486079035-project-member] Enqueued Resource ID: aed1fbdc-e1dd-470f-b2cb-80855c0346b5 with Priority: HIGHEST for action port [ 769.170860] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d79a9e34-ff20-4d67-b0ec-c75b2bb20610 with Priority: HIGHEST for action security_group_rules [ 769.170991] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d79a9e34-ff20-4d67-b0ec-c75b2bb20610 with Priority: HIGHEST for action security_group_members [ 769.171105] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aed1fbdc-e1dd-470f-b2cb-80855c0346b5 with Priority: HIGHEST for action port [ 769.171377] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d79a9e34-ff20-4d67-b0ec-c75b2bb20610 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.171498] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d79a9e34-ff20-4d67-b0ec-c75b2bb20610" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.171700] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-d79a9e34-ff20-4d67-b0ec-c75b2bb20610 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.171804] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d79a9e34-ff20-4d67-b0ec-c75b2bb20610" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.171965] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-aed1fbdc-e1dd-470f-b2cb-80855c0346b5 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.172082] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aed1fbdc-e1dd-470f-b2cb-80855c0346b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.172158] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aed1fbdc-e1dd-470f-b2cb-80855c0346b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.172361] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aed1fbdc-e1dd-470f-b2cb-80855c0346b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.172467] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aed1fbdc-e1dd-470f-b2cb-80855c0346b5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.615334] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.615334] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.615334] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.615547] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.615579] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.616618] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.616618] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.616618] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.616787] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.616787] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.616897] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0999f45-c89f-488f-b038-36a93b2cdeb4 is going to be updated. [ 769.658614] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.658878] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.658972] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.659222] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.659312] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.659445] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d79a9e34-ff20-4d67-b0ec-c75b2bb20610 is going to be updated. [ 769.661077] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.661900] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.662011] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.662350] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.662713] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.662860] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5429c224-badd-4df6-b72c-e9a34b52b264 is going to be created. [ 769.676407] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.676407] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.676407] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.676407] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.676407] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.679068] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aed1fbdc-e1dd-470f-b2cb-80855c0346b5 with status ACTIVE [ 769.679068] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.679068] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.679068] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.679467] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.679467] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.679562] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.679629] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.679629] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.679783] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.679858] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.680048] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.680143] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.680209] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.680343] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.680417] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.680510] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aed1fbdc-e1dd-470f-b2cb-80855c0346b5 is going to be updated. [ 769.698823] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0999f45-c89f-488f-b038-36a93b2cdeb4 in Status: IN_PROGRESS for 2s [ 769.701905] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.702126] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.702192] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.702412] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.702563] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.721997] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.722177] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.722299] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.722485] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.722636] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.722816] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aed1fbdc-e1dd-470f-b2cb-80855c0346b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.729258] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5429c224-badd-4df6-b72c-e9a34b52b264 in Status: UNINITIALIZED for 2s [ 769.730409] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.730617] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.730687] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.730907] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.731313] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.745449] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d79a9e34-ff20-4d67-b0ec-c75b2bb20610 in Status: IN_PROGRESS for 2s [ 770.136770] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c1385665-0c09-423f-98c4-4d6b46c66ec0 in Status: SUCCESS [ 770.136770] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c1385665-0c09-423f-98c4-4d6b46c66ec0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.235585] env[70392]: INFO networking_nsxv3.common.synchronization [req-cd615179-551a-4035-8734-03ff8c18fbaa req-46ceadc4-28a4-4a52-bf33-390c6399fb98 tempest-ServerDiagnosticsNegativeTest-997856407 tempest-ServerDiagnosticsNegativeTest-997856407-project-member] Enqueued Resource ID: c6ed4920-0e6a-4b44-ab86-2e2af45392fb with Priority: HIGHEST for action security_group_members [ 770.235585] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6ed4920-0e6a-4b44-ab86-2e2af45392fb with Priority: HIGHEST for action security_group_members [ 770.235585] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6ed4920-0e6a-4b44-ab86-2e2af45392fb taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.235585] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6ed4920-0e6a-4b44-ab86-2e2af45392fb" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.235585] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6ed4920-0e6a-4b44-ab86-2e2af45392fb" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.236149] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6ed4920-0e6a-4b44-ab86-2e2af45392fb" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.236478] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.238353] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.238706] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.239129] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.239483] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.240828] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6ed4920-0e6a-4b44-ab86-2e2af45392fb',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.742198] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.742356] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.742539] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.742705] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.742805] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.743076] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.743215] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.743264] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.743514] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.743620] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.743718] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6ed4920-0e6a-4b44-ab86-2e2af45392fb already deleted. [ 770.743885] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6ed4920-0e6a-4b44-ab86-2e2af45392fb" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.784668] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-325 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.786130] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-325" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.789022] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-325" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.789022] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-325" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.789022] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.789022] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.789022] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.789022] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.789022] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.789022] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 770.789022] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 770.790363] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 770.790707] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 770.791054] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 770.791391] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 770.794662] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 770.816033] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 770.816033] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 770.816033] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 770.816033] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-325" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.816033] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-326a4a2f-6db9-4538-b0cf-0e990ac2f916 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.816033] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-326a4a2f-6db9-4538-b0cf-0e990ac2f916" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.816033] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-326a4a2f-6db9-4538-b0cf-0e990ac2f916" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.816033] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-326a4a2f-6db9-4538-b0cf-0e990ac2f916" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.816033] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('326a4a2f-6db9-4538-b0cf-0e990ac2f916',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.319337] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.320166] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.320166] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.320166] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.320561] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.320561] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 326a4a2f-6db9-4538-b0cf-0e990ac2f916 not found, creating... [ 771.320818] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.321140] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.321834] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.322363] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.322677] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.323557] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.323557] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.323930] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.324313] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.324487] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.325461] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 326a4a2f-6db9-4538-b0cf-0e990ac2f916 is going to be created. [ 771.348598] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.348598] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.348598] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.348791] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.349130] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.349272] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-326a4a2f-6db9-4538-b0cf-0e990ac2f916" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.711686] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0999f45-c89f-488f-b038-36a93b2cdeb4 in Status: SUCCESS [ 771.712671] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0999f45-c89f-488f-b038-36a93b2cdeb4 deletion is rescheduled due to dependency. [ 771.712877] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0999f45-c89f-488f-b038-36a93b2cdeb4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.738144] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5429c224-badd-4df6-b72c-e9a34b52b264 in Status: SUCCESS [ 771.740130] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5429c224-badd-4df6-b72c-e9a34b52b264" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.740130] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5429c224-badd-4df6-b72c-e9a34b52b264" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.740130] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5429c224-badd-4df6-b72c-e9a34b52b264" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.740130] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.740130] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.740130] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.740130] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.740130] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.740130] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5429c224-badd-4df6-b72c-e9a34b52b264',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.756766] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d79a9e34-ff20-4d67-b0ec-c75b2bb20610 in Status: SUCCESS [ 771.756766] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d79a9e34-ff20-4d67-b0ec-c75b2bb20610" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.756766] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d79a9e34-ff20-4d67-b0ec-c75b2bb20610" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.756766] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d79a9e34-ff20-4d67-b0ec-c75b2bb20610" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.756766] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.756766] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.756766] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.756766] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.756766] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.757199] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d79a9e34-ff20-4d67-b0ec-c75b2bb20610',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.803157] env[70392]: INFO networking_nsxv3.common.synchronization [None req-1d4ffeaf-fc47-4853-9b07-2957919c9364 None None] Enqueued Resource ID: b6747e98-8972-4171-91b8-605101dd1b4f with Priority: HIGHEST for action port [ 771.803818] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6747e98-8972-4171-91b8-605101dd1b4f with Priority: HIGHEST for action port [ 771.805264] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-b6747e98-8972-4171-91b8-605101dd1b4f taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.806181] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b6747e98-8972-4171-91b8-605101dd1b4f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.806345] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b6747e98-8972-4171-91b8-605101dd1b4f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.808212] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b6747e98-8972-4171-91b8-605101dd1b4f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.808212] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b6747e98-8972-4171-91b8-605101dd1b4f',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.243022] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.243188] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.243260] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.243487] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.243577] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.243798] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.243896] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.243957] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.244122] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.244198] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.244284] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5429c224-badd-4df6-b72c-e9a34b52b264 is going to be deleted. [ 772.262939] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d79a9e34-ff20-4d67-b0ec-c75b2bb20610',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.308795] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b6747e98-8972-4171-91b8-605101dd1b4f [ 772.309060] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.309206] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.309282] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.309529] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.309626] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.309724] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b6747e98-8972-4171-91b8-605101dd1b4f already deleted. [ 772.309802] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b6747e98-8972-4171-91b8-605101dd1b4f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.384514] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.384915] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.384985] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.385559] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.385751] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.385976] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5429c224-badd-4df6-b72c-e9a34b52b264" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.386187] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5429c224-badd-4df6-b72c-e9a34b52b264" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.386369] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5429c224-badd-4df6-b72c-e9a34b52b264" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.386550] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.386646] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.386709] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.387070] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.387160] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.387261] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5429c224-badd-4df6-b72c-e9a34b52b264',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.765509] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d79a9e34-ff20-4d67-b0ec-c75b2bb20610',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.894030] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.894030] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.894030] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.894030] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.894030] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.894030] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.894030] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.894030] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.895526] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.895526] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.895526] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5429c224-badd-4df6-b72c-e9a34b52b264 already deleted. [ 772.895526] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5429c224-badd-4df6-b72c-e9a34b52b264" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.898042] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5429c224-badd-4df6-b72c-e9a34b52b264',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.898042] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5429c224-badd-4df6-b72c-e9a34b52b264" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.898042] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5429c224-badd-4df6-b72c-e9a34b52b264" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.898042] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.898042] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.898042] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.898042] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.898042] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.898543] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5429c224-badd-4df6-b72c-e9a34b52b264',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.932929] env[70392]: INFO networking_nsxv3.common.synchronization [req-a2daa201-3a46-4959-8d57-6dc503a8df82 req-f5456d21-3530-4e05-ab85-784c69be915c tempest-ServerDiskConfigTestJSON-277542510 tempest-ServerDiskConfigTestJSON-277542510-project-member] Enqueued Resource ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 with Priority: HIGHEST for action security_group_members [ 772.933549] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 with Priority: HIGHEST for action security_group_members [ 772.933868] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60d7eaa-9583-4c75-97fa-4049c63576b6 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.933991] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.934072] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.934607] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.934607] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.934607] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.934816] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.934987] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.935112] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.935213] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b60d7eaa-9583-4c75-97fa-4049c63576b6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.969850] env[70392]: INFO networking_nsxv3.common.synchronization [req-cd615179-551a-4035-8734-03ff8c18fbaa req-9b6ae5a0-f6e4-4387-a51a-24b25af95e56 service nova] Enqueued Resource ID: c6ed4920-0e6a-4b44-ab86-2e2af45392fb with Priority: HIGHEST for action security_group_rules [ 772.969850] env[70392]: INFO networking_nsxv3.common.synchronization [req-cd615179-551a-4035-8734-03ff8c18fbaa req-9b6ae5a0-f6e4-4387-a51a-24b25af95e56 service nova] Enqueued Resource ID: c6ed4920-0e6a-4b44-ab86-2e2af45392fb with Priority: HIGHEST for action security_group_members [ 772.969850] env[70392]: INFO networking_nsxv3.common.synchronization [req-cd615179-551a-4035-8734-03ff8c18fbaa req-9b6ae5a0-f6e4-4387-a51a-24b25af95e56 service nova] Enqueued Resource ID: 326a4a2f-6db9-4538-b0cf-0e990ac2f916 with Priority: HIGHEST for action port [ 772.969850] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6ed4920-0e6a-4b44-ab86-2e2af45392fb with Priority: HIGHEST for action security_group_rules [ 772.969850] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6ed4920-0e6a-4b44-ab86-2e2af45392fb with Priority: HIGHEST for action security_group_members [ 772.969850] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 326a4a2f-6db9-4538-b0cf-0e990ac2f916 with Priority: HIGHEST for action port [ 772.970231] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c6ed4920-0e6a-4b44-ab86-2e2af45392fb taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.970639] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c6ed4920-0e6a-4b44-ab86-2e2af45392fb" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.970808] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c6ed4920-0e6a-4b44-ab86-2e2af45392fb" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.971281] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c6ed4920-0e6a-4b44-ab86-2e2af45392fb" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.973753] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c6ed4920-0e6a-4b44-ab86-2e2af45392fb',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.975083] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6ed4920-0e6a-4b44-ab86-2e2af45392fb taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.976603] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6ed4920-0e6a-4b44-ab86-2e2af45392fb" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.977226] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6ed4920-0e6a-4b44-ab86-2e2af45392fb" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.983022] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6ed4920-0e6a-4b44-ab86-2e2af45392fb" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.983022] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.983022] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.983022] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.983022] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.983022] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.983022] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6ed4920-0e6a-4b44-ab86-2e2af45392fb',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.983877] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-326a4a2f-6db9-4538-b0cf-0e990ac2f916 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.984189] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-326a4a2f-6db9-4538-b0cf-0e990ac2f916" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.985050] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-326a4a2f-6db9-4538-b0cf-0e990ac2f916" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.985050] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-326a4a2f-6db9-4538-b0cf-0e990ac2f916" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.985875] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('326a4a2f-6db9-4538-b0cf-0e990ac2f916',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.274566] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.274724] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.274799] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.275045] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.275163] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.275275] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d79a9e34-ff20-4d67-b0ec-c75b2bb20610 is going to be updated. [ 773.312915] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.312915] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.313165] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.313559] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.313702] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.324637] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d79a9e34-ff20-4d67-b0ec-c75b2bb20610 in Status: IN_PROGRESS for 2s [ 773.400518] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5429c224-badd-4df6-b72c-e9a34b52b264',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.402274] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.402436] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.402797] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.402797] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.402994] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.403360] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.403360] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.403488] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.404085] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.404194] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.404301] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5429c224-badd-4df6-b72c-e9a34b52b264 already deleted. [ 773.404610] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5429c224-badd-4df6-b72c-e9a34b52b264" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.441575] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.442611] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.442611] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.442611] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.442791] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.442907] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.443022] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.443085] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.443248] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.443329] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.443422] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 is going to be updated. [ 773.483241] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.483390] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.483464] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.483724] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.483875] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.487850] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c6ed4920-0e6a-4b44-ab86-2e2af45392fb',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.488894] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6ed4920-0e6a-4b44-ab86-2e2af45392fb taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.489029] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6ed4920-0e6a-4b44-ab86-2e2af45392fb" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.492224] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 326a4a2f-6db9-4538-b0cf-0e990ac2f916 with status ACTIVE [ 773.492224] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.492224] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.492224] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.492224] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.492224] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.492224] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.492224] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.492224] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.492224] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.492224] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.493777] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.493777] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.493885] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.494025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.494113] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.494203] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 326a4a2f-6db9-4538-b0cf-0e990ac2f916 is going to be updated. [ 773.516734] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 in Status: IN_PROGRESS for 2s [ 773.532946] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.533026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.533056] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.533838] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.533838] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.533838] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-326a4a2f-6db9-4538-b0cf-0e990ac2f916" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.680638] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-256 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.680842] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-256" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.680953] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-256" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.681254] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-256" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.681507] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.681658] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.681768] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.681989] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.682669] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.682669] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 773.682669] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 773.682669] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 773.682669] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 773.682943] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 773.682943] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 773.683034] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 773.728100] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 773.728381] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.045 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 773.728650] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 773.728898] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-256" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.730190] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-0b33b0ec-e6e1-4177-8d7a-652da818503b taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.730481] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-0b33b0ec-e6e1-4177-8d7a-652da818503b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.730665] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-0b33b0ec-e6e1-4177-8d7a-652da818503b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.731118] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-0b33b0ec-e6e1-4177-8d7a-652da818503b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.731281] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b33b0ec-e6e1-4177-8d7a-652da818503b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.905513] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5429c224-badd-4df6-b72c-e9a34b52b264: rpc.has_security_group_logging(os_id): False [ 773.930835] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.930991] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.931075] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.932226] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.932226] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.932226] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.932226] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.932226] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.932226] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.932226] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.932226] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5429c224-badd-4df6-b72c-e9a34b52b264 is going to be created. [ 773.960881] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/5429c224-badd-4df6-b72c-e9a34b52b264], does not exist path=[/infra/domains/default/groups/5429c224-badd-4df6-b72c-e9a34b52b264]."\n}' [ 773.961067] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5429c224-badd-4df6-b72c-e9a34b52b264 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/5429c224-badd-4df6-b72c-e9a34b52b264 [ 773.961460] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 773.992853] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.993092] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.993225] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.993532] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.994467] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.994715] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.994831] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.994890] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.996373] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.996479] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.996709] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.997106] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.997106] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.997106] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.997199] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.997231] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5429c224-badd-4df6-b72c-e9a34b52b264 is going to be created. [ 773.999322] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c6ed4920-0e6a-4b44-ab86-2e2af45392fb',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.019284] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/5429c224-badd-4df6-b72c-e9a34b52b264], does not exist path=[/infra/domains/default/groups/5429c224-badd-4df6-b72c-e9a34b52b264]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/5429c224-badd-4df6-b72c-e9a34b52b264 [ 774.019284] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5429c224-badd-4df6-b72c-e9a34b52b264" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.019284] env[70392]: Traceback (most recent call last): [ 774.019284] env[70392]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 774.019284] env[70392]: return func(*args, **kwargs) [ 774.019284] env[70392]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 774.019284] env[70392]: res.raise_for_status() [ 774.019284] env[70392]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 774.019284] env[70392]: raise HTTPError(http_error_msg, response=self) [ 774.019284] env[70392]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/5429c224-badd-4df6-b72c-e9a34b52b264 [ 774.019284] env[70392]: During handling of the above exception, another exception occurred: [ 774.019284] env[70392]: Traceback (most recent call last): [ 774.019284] env[70392]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 774.019284] env[70392]: listener.cb(fileno) [ 774.019284] env[70392]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 774.019284] env[70392]: result = function(*args, **kwargs) [ 774.019284] env[70392]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 774.019284] env[70392]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 774.019284] env[70392]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 774.019284] env[70392]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 774.019284] env[70392]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 774.019284] env[70392]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 774.019284] env[70392]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 774.019284] env[70392]: res.raise_for_status() [ 774.019284] env[70392]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 774.019284] env[70392]: raise HTTPError(http_error_msg, response=self) [ 774.019284] env[70392]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/5429c224-badd-4df6-b72c-e9a34b52b264 [ 774.019284] env[70392]: Removing descriptor: 23 [ 774.235055] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.235055] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.235055] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.235055] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.235055] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.235368] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 0b33b0ec-e6e1-4177-8d7a-652da818503b not found, creating... [ 774.236918] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.236918] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.236918] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.236918] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.236918] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.236918] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.236918] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.236918] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.237319] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.237390] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.237564] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 0b33b0ec-e6e1-4177-8d7a-652da818503b is going to be created. [ 774.265205] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.265205] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.265205] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.265205] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.265205] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.265597] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-0b33b0ec-e6e1-4177-8d7a-652da818503b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.331176] env[70392]: INFO networking_nsxv3.common.synchronization [None req-7291791a-3d8a-45cc-aa76-8a27b1262d24 None None] Enqueued Resource ID: fc2bc303-cfd3-4f32-b5d7-f813cbb0d6cf with Priority: HIGHEST for action port [ 774.331176] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc2bc303-cfd3-4f32-b5d7-f813cbb0d6cf with Priority: HIGHEST for action port [ 774.331621] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc2bc303-cfd3-4f32-b5d7-f813cbb0d6cf taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.331748] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc2bc303-cfd3-4f32-b5d7-f813cbb0d6cf" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.331817] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc2bc303-cfd3-4f32-b5d7-f813cbb0d6cf" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.333437] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc2bc303-cfd3-4f32-b5d7-f813cbb0d6cf" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.333437] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc2bc303-cfd3-4f32-b5d7-f813cbb0d6cf',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.503524] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.503524] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.503524] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.503524] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.503524] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.503524] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6ed4920-0e6a-4b44-ab86-2e2af45392fb is going to be created. [ 774.535529] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.537659] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.537659] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.537659] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.537659] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.546872] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6ed4920-0e6a-4b44-ab86-2e2af45392fb in Status: UNINITIALIZED for 2s [ 774.762919] env[70392]: INFO networking_nsxv3.common.synchronization [None req-c9becffc-3f00-4409-b269-d2eaf2be38ae None None] Enqueued Resource ID: 0cc92a77-ffe7-4e1b-8ae0-af825d19d098 with Priority: HIGHEST for action port [ 774.766035] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cc92a77-ffe7-4e1b-8ae0-af825d19d098 with Priority: HIGHEST for action port [ 774.766035] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-0cc92a77-ffe7-4e1b-8ae0-af825d19d098 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.766035] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0cc92a77-ffe7-4e1b-8ae0-af825d19d098" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.766035] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0cc92a77-ffe7-4e1b-8ae0-af825d19d098" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.766035] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0cc92a77-ffe7-4e1b-8ae0-af825d19d098" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.766035] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0cc92a77-ffe7-4e1b-8ae0-af825d19d098',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.835534] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fc2bc303-cfd3-4f32-b5d7-f813cbb0d6cf [ 774.835950] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.835950] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.836161] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.836217] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.836303] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.836402] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fc2bc303-cfd3-4f32-b5d7-f813cbb0d6cf already deleted. [ 774.836475] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc2bc303-cfd3-4f32-b5d7-f813cbb0d6cf" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.266862] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0cc92a77-ffe7-4e1b-8ae0-af825d19d098 [ 775.270857] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.270857] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.270857] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.270857] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.270857] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.270857] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0cc92a77-ffe7-4e1b-8ae0-af825d19d098 already deleted. [ 775.270857] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0cc92a77-ffe7-4e1b-8ae0-af825d19d098" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.337883] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d79a9e34-ff20-4d67-b0ec-c75b2bb20610 in Status: SUCCESS [ 775.338126] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d79a9e34-ff20-4d67-b0ec-c75b2bb20610" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.338295] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d79a9e34-ff20-4d67-b0ec-c75b2bb20610" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.338507] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d79a9e34-ff20-4d67-b0ec-c75b2bb20610" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.338727] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.338848] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.338913] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.339090] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.339174] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.339262] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d79a9e34-ff20-4d67-b0ec-c75b2bb20610" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.339503] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d79a9e34-ff20-4d67-b0ec-c75b2bb20610',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.341676] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d79a9e34-ff20-4d67-b0ec-c75b2bb20610" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.345528] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d79a9e34-ff20-4d67-b0ec-c75b2bb20610" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.346310] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.346396] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.346461] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.346694] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.346772] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.346878] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d79a9e34-ff20-4d67-b0ec-c75b2bb20610',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.526928] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 in Status: SUCCESS [ 775.526928] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 deletion is rescheduled due to dependency. [ 775.527269] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.587700] env[70392]: INFO networking_nsxv3.common.synchronization [req-a2daa201-3a46-4959-8d57-6dc503a8df82 req-23306d08-e3cc-4482-baab-c6afbebf0e0c service nova] Enqueued Resource ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 with Priority: HIGHEST for action security_group_rules [ 775.587881] env[70392]: INFO networking_nsxv3.common.synchronization [req-a2daa201-3a46-4959-8d57-6dc503a8df82 req-23306d08-e3cc-4482-baab-c6afbebf0e0c service nova] Enqueued Resource ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 with Priority: HIGHEST for action security_group_members [ 775.588034] env[70392]: INFO networking_nsxv3.common.synchronization [req-a2daa201-3a46-4959-8d57-6dc503a8df82 req-23306d08-e3cc-4482-baab-c6afbebf0e0c service nova] Enqueued Resource ID: 0b33b0ec-e6e1-4177-8d7a-652da818503b with Priority: HIGHEST for action port [ 775.588524] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 with Priority: HIGHEST for action security_group_rules [ 775.588782] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 with Priority: HIGHEST for action security_group_members [ 775.588782] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b33b0ec-e6e1-4177-8d7a-652da818503b with Priority: HIGHEST for action port [ 775.589806] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b60d7eaa-9583-4c75-97fa-4049c63576b6 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.589903] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.589966] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.590214] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.590302] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b60d7eaa-9583-4c75-97fa-4049c63576b6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.592680] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60d7eaa-9583-4c75-97fa-4049c63576b6 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.593873] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.593993] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.594217] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.594390] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.594498] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.594571] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.599057] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.599313] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.599313] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b60d7eaa-9583-4c75-97fa-4049c63576b6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.600818] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-0b33b0ec-e6e1-4177-8d7a-652da818503b taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.600989] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0b33b0ec-e6e1-4177-8d7a-652da818503b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.601128] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0b33b0ec-e6e1-4177-8d7a-652da818503b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.601290] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0b33b0ec-e6e1-4177-8d7a-652da818503b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.601373] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b33b0ec-e6e1-4177-8d7a-652da818503b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.613815] env[70392]: INFO networking_nsxv3.common.synchronization [req-7976fbd9-679e-4771-a76e-20c77e3dd60b req-f9a95a11-7b06-4153-b5db-c2de5109f866 tempest-FloatingIPsAssociationTestJSON-516556258 tempest-FloatingIPsAssociationTestJSON-516556258-project-member] Enqueued Resource ID: 87729ccf-b5c1-4c71-b616-13269541067e with Priority: HIGHEST for action security_group_members [ 775.615945] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87729ccf-b5c1-4c71-b616-13269541067e with Priority: HIGHEST for action security_group_members [ 775.615945] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-87729ccf-b5c1-4c71-b616-13269541067e taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.615945] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87729ccf-b5c1-4c71-b616-13269541067e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.615945] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87729ccf-b5c1-4c71-b616-13269541067e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.615945] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87729ccf-b5c1-4c71-b616-13269541067e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.615945] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.615945] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.615945] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.618645] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.618645] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.618645] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('87729ccf-b5c1-4c71-b616-13269541067e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.849692] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-d79a9e34-ff20-4d67-b0ec-c75b2bb20610 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.849692] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d79a9e34-ff20-4d67-b0ec-c75b2bb20610" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.851184] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d79a9e34-ff20-4d67-b0ec-c75b2bb20610',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.094016] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60d7eaa-9583-4c75-97fa-4049c63576b6 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.094266] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.105394] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b60d7eaa-9583-4c75-97fa-4049c63576b6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.105804] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0b33b0ec-e6e1-4177-8d7a-652da818503b with status ACTIVE [ 776.106034] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.106157] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.106225] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.106430] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.106572] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.106710] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.106813] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.106874] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.107036] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.107116] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.107298] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.107389] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.107559] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.107612] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.107664] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.107746] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0b33b0ec-e6e1-4177-8d7a-652da818503b is going to be updated. [ 776.112574] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-517 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.112876] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-517" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.113018] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-517" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.114327] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-517" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.114505] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.114695] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.114901] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.115052] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.115232] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.116053] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 776.116053] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 776.116053] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 776.116053] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 776.116053] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 776.116053] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 776.116418] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 776.119500] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('87729ccf-b5c1-4c71-b616-13269541067e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.138097] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 776.138479] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 776.138711] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 776.138843] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-517" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.139219] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-5adecc2f-551f-4d07-8b19-26865e60bb17 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.139437] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-5adecc2f-551f-4d07-8b19-26865e60bb17" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.139533] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-5adecc2f-551f-4d07-8b19-26865e60bb17" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.139977] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-5adecc2f-551f-4d07-8b19-26865e60bb17" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.140091] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5adecc2f-551f-4d07-8b19-26865e60bb17',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.142378] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.142378] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.142378] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.142550] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.143398] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.143398] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0b33b0ec-e6e1-4177-8d7a-652da818503b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.353471] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d79a9e34-ff20-4d67-b0ec-c75b2bb20610',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.557950] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6ed4920-0e6a-4b44-ab86-2e2af45392fb in Status: SUCCESS [ 776.558231] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6ed4920-0e6a-4b44-ab86-2e2af45392fb" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.558404] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6ed4920-0e6a-4b44-ab86-2e2af45392fb" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.558693] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6ed4920-0e6a-4b44-ab86-2e2af45392fb" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.558892] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.559113] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.559113] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.559244] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.559324] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.559412] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6ed4920-0e6a-4b44-ab86-2e2af45392fb" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.559517] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c6ed4920-0e6a-4b44-ab86-2e2af45392fb',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.612323] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b60d7eaa-9583-4c75-97fa-4049c63576b6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.622825] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('87729ccf-b5c1-4c71-b616-13269541067e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.646064] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.646064] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.646064] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.646064] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.646064] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.646064] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 5adecc2f-551f-4d07-8b19-26865e60bb17 not found, creating... [ 776.646064] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.646332] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.646332] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.646577] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.646727] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.647023] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.647190] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.648046] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.648046] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.648046] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.648046] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 5adecc2f-551f-4d07-8b19-26865e60bb17 is going to be created. [ 776.678589] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.678747] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.678902] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.679269] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.679483] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.679769] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-5adecc2f-551f-4d07-8b19-26865e60bb17" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.800629] env[70392]: INFO networking_nsxv3.common.synchronization [None req-c47eafe3-828d-44e5-85cf-290ce17c3394 tempest-ServerActionsTestOtherA-1411478130 tempest-ServerActionsTestOtherA-1411478130-project-member] Enqueued Resource ID: 47a435cb-d815-4f84-b215-41c82faf33b9 with Priority: HIGHEST for action security_group_rules [ 776.801382] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47a435cb-d815-4f84-b215-41c82faf33b9 with Priority: HIGHEST for action security_group_rules [ 776.801696] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-47a435cb-d815-4f84-b215-41c82faf33b9 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.801696] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.801696] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.801997] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.802080] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('47a435cb-d815-4f84-b215-41c82faf33b9',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.861145] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.861145] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.861145] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.861145] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.861145] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.861145] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d79a9e34-ff20-4d67-b0ec-c75b2bb20610 is going to be updated. [ 776.897087] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.897769] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.897948] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.898307] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.899185] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.913979] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d79a9e34-ff20-4d67-b0ec-c75b2bb20610 in Status: IN_PROGRESS for 2s [ 776.950327] env[70392]: INFO networking_nsxv3.common.synchronization [None req-3efef56e-0789-4a19-bdd3-9dc84da6f002 None None] Enqueued Resource ID: ad317e11-ad42-4f02-a209-d2818b07b0e8 with Priority: HIGHEST for action port [ 776.950327] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad317e11-ad42-4f02-a209-d2818b07b0e8 with Priority: HIGHEST for action port [ 776.950514] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-ad317e11-ad42-4f02-a209-d2818b07b0e8 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.950514] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ad317e11-ad42-4f02-a209-d2818b07b0e8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.950584] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ad317e11-ad42-4f02-a209-d2818b07b0e8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.950826] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ad317e11-ad42-4f02-a209-d2818b07b0e8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.954319] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad317e11-ad42-4f02-a209-d2818b07b0e8',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.004061] env[70392]: INFO networking_nsxv3.common.synchronization [None req-cb355ada-3569-4ca4-8ca4-6145b3797797 tempest-ServerActionsTestOtherA-1411478130 tempest-ServerActionsTestOtherA-1411478130-project-member] Enqueued Resource ID: 47a435cb-d815-4f84-b215-41c82faf33b9 with Priority: HIGHEST for action security_group_rules [ 777.005036] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47a435cb-d815-4f84-b215-41c82faf33b9 with Priority: HIGHEST for action security_group_rules [ 777.005728] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-47a435cb-d815-4f84-b215-41c82faf33b9 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.005728] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.065823] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6ed4920-0e6a-4b44-ab86-2e2af45392fb taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.066027] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6ed4920-0e6a-4b44-ab86-2e2af45392fb" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.066117] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6ed4920-0e6a-4b44-ab86-2e2af45392fb" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.066406] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6ed4920-0e6a-4b44-ab86-2e2af45392fb" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.066647] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.066844] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.066893] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.067089] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.067184] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.067281] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6ed4920-0e6a-4b44-ab86-2e2af45392fb" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.067433] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6ed4920-0e6a-4b44-ab86-2e2af45392fb taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.067527] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6ed4920-0e6a-4b44-ab86-2e2af45392fb" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.067609] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6ed4920-0e6a-4b44-ab86-2e2af45392fb" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.067737] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6ed4920-0e6a-4b44-ab86-2e2af45392fb" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.067875] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.067971] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.067971] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.068186] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.068930] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.068930] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6ed4920-0e6a-4b44-ab86-2e2af45392fb" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.068930] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c6ed4920-0e6a-4b44-ab86-2e2af45392fb',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.118531] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.118770] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.118844] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.119064] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.119160] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.119262] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 is going to be updated. [ 777.126147] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.127222] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.127376] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.129037] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.129037] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.129037] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 87729ccf-b5c1-4c71-b616-13269541067e is going to be updated. [ 777.153616] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.153805] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.153844] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.154049] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.154661] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.157146] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.157360] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.157474] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.157708] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.157891] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.176914] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 in Status: IN_PROGRESS for 2s [ 777.179508] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87729ccf-b5c1-4c71-b616-13269541067e in Status: IN_PROGRESS for 2s [ 777.322799] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.322970] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.323029] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.323291] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.323331] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.323425] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 47a435cb-d815-4f84-b215-41c82faf33b9 already deleted. [ 777.323510] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.323664] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.323817] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.323900] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('47a435cb-d815-4f84-b215-41c82faf33b9',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.457096] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ad317e11-ad42-4f02-a209-d2818b07b0e8 [ 777.457354] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.457487] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.457567] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.457799] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.457898] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.457999] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ad317e11-ad42-4f02-a209-d2818b07b0e8 already deleted. [ 777.458141] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ad317e11-ad42-4f02-a209-d2818b07b0e8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.573606] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c6ed4920-0e6a-4b44-ab86-2e2af45392fb: rpc.has_security_group_logging(os_id): False [ 777.594938] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.594938] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.594938] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.595631] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.595823] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.595975] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.596118] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.596184] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.596360] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.596438] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.597158] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.597158] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.597158] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.597158] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.597158] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.598129] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.598246] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.598315] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.598488] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.598613] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.598691] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c6ed4920-0e6a-4b44-ab86-2e2af45392fb is going to be created. [ 777.664578] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.664785] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.664854] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.665116] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.665327] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.680928] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c6ed4920-0e6a-4b44-ab86-2e2af45392fb in Status: IN_PROGRESS for 2s [ 777.851901] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.852077] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.852151] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.852375] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.852464] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.852566] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 47a435cb-d815-4f84-b215-41c82faf33b9 already deleted. [ 777.852648] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.972761] env[70392]: INFO networking_nsxv3.common.synchronization [req-7976fbd9-679e-4771-a76e-20c77e3dd60b req-8b5b1b6c-cd17-4978-ad9c-723817503ad9 service nova] Enqueued Resource ID: 87729ccf-b5c1-4c71-b616-13269541067e with Priority: HIGHEST for action security_group_rules [ 777.972946] env[70392]: INFO networking_nsxv3.common.synchronization [req-7976fbd9-679e-4771-a76e-20c77e3dd60b req-8b5b1b6c-cd17-4978-ad9c-723817503ad9 service nova] Enqueued Resource ID: 87729ccf-b5c1-4c71-b616-13269541067e with Priority: HIGHEST for action security_group_members [ 777.973142] env[70392]: INFO networking_nsxv3.common.synchronization [req-7976fbd9-679e-4771-a76e-20c77e3dd60b req-8b5b1b6c-cd17-4978-ad9c-723817503ad9 service nova] Enqueued Resource ID: 5adecc2f-551f-4d07-8b19-26865e60bb17 with Priority: HIGHEST for action port [ 777.975636] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87729ccf-b5c1-4c71-b616-13269541067e with Priority: HIGHEST for action security_group_rules [ 777.975636] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87729ccf-b5c1-4c71-b616-13269541067e with Priority: HIGHEST for action security_group_members [ 777.975636] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5adecc2f-551f-4d07-8b19-26865e60bb17 with Priority: HIGHEST for action port [ 777.975636] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-87729ccf-b5c1-4c71-b616-13269541067e taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.975636] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-87729ccf-b5c1-4c71-b616-13269541067e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.975636] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-87729ccf-b5c1-4c71-b616-13269541067e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.975636] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-87729ccf-b5c1-4c71-b616-13269541067e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.975636] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('87729ccf-b5c1-4c71-b616-13269541067e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.977683] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-87729ccf-b5c1-4c71-b616-13269541067e taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.977683] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87729ccf-b5c1-4c71-b616-13269541067e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.977683] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-5adecc2f-551f-4d07-8b19-26865e60bb17 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.977861] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5adecc2f-551f-4d07-8b19-26865e60bb17" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.977861] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5adecc2f-551f-4d07-8b19-26865e60bb17" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.978031] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5adecc2f-551f-4d07-8b19-26865e60bb17" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.978109] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5adecc2f-551f-4d07-8b19-26865e60bb17',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.477971] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-87729ccf-b5c1-4c71-b616-13269541067e taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.478143] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87729ccf-b5c1-4c71-b616-13269541067e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.481046] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5adecc2f-551f-4d07-8b19-26865e60bb17 with status ACTIVE [ 778.481046] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.481046] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.481324] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.481384] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.481499] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.481692] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.481789] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.481852] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.482035] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.482122] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.482308] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.482403] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.482457] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.482603] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.482679] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.482783] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5adecc2f-551f-4d07-8b19-26865e60bb17 is going to be updated. [ 778.506480] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.506626] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.506696] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.506915] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.507351] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.507560] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5adecc2f-551f-4d07-8b19-26865e60bb17" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.925165] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d79a9e34-ff20-4d67-b0ec-c75b2bb20610 in Status: SUCCESS [ 778.925505] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d79a9e34-ff20-4d67-b0ec-c75b2bb20610" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.925573] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d79a9e34-ff20-4d67-b0ec-c75b2bb20610" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.927043] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d79a9e34-ff20-4d67-b0ec-c75b2bb20610" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.927043] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.927043] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.927043] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.930311] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.930601] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.930601] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d79a9e34-ff20-4d67-b0ec-c75b2bb20610',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.073796] env[70392]: INFO networking_nsxv3.common.synchronization [req-9090d394-2c3b-429f-bae5-cf86662d781b req-f4278154-2063-4af2-93f3-220d61cf9bc9 tempest-ServerRescueTestJSONUnderV235-1486079035 tempest-ServerRescueTestJSONUnderV235-1486079035-project-member] Enqueued Resource ID: d79a9e34-ff20-4d67-b0ec-c75b2bb20610 with Priority: HIGHEST for action security_group_members [ 779.074348] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d79a9e34-ff20-4d67-b0ec-c75b2bb20610 with Priority: HIGHEST for action security_group_members [ 779.074636] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-d79a9e34-ff20-4d67-b0ec-c75b2bb20610 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.074732] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d79a9e34-ff20-4d67-b0ec-c75b2bb20610" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.361651] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 in Status: SUCCESS [ 779.361877] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.362066] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.362329] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.362573] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.362695] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.362793] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.362922] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.363013] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.363104] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.363215] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b60d7eaa-9583-4c75-97fa-4049c63576b6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.364815] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87729ccf-b5c1-4c71-b616-13269541067e in Status: SUCCESS [ 779.365015] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87729ccf-b5c1-4c71-b616-13269541067e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.365239] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87729ccf-b5c1-4c71-b616-13269541067e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.365413] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87729ccf-b5c1-4c71-b616-13269541067e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.365585] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.365687] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.365750] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.365891] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.365970] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.366073] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('87729ccf-b5c1-4c71-b616-13269541067e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.433372] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d79a9e34-ff20-4d67-b0ec-c75b2bb20610',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.693315] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c6ed4920-0e6a-4b44-ab86-2e2af45392fb in Status: SUCCESS [ 779.693552] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c6ed4920-0e6a-4b44-ab86-2e2af45392fb" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.869148] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60d7eaa-9583-4c75-97fa-4049c63576b6 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.869148] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.869148] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.869148] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.869148] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.869148] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.869148] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.869148] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.869148] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.869148] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.869590] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60d7eaa-9583-4c75-97fa-4049c63576b6 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.869590] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.869590] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.869590] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.869714] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.869755] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.869884] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.869936] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.870056] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.870117] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.870207] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b60d7eaa-9583-4c75-97fa-4049c63576b6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.871148] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('87729ccf-b5c1-4c71-b616-13269541067e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.936684] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d79a9e34-ff20-4d67-b0ec-c75b2bb20610',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.372413] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b60d7eaa-9583-4c75-97fa-4049c63576b6: rpc.has_security_group_logging(os_id): False [ 780.373565] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('87729ccf-b5c1-4c71-b616-13269541067e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.392327] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.392468] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.392516] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.392729] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.415272] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.415272] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.415272] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.415272] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.415272] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.415272] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.415272] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.415272] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.415671] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.415906] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.415990] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.416218] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.416328] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.416389] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.416569] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.416648] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.416732] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 is going to be updated. [ 780.443325] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.443325] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.443325] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.443325] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.443325] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.443325] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d79a9e34-ff20-4d67-b0ec-c75b2bb20610 is going to be updated. [ 780.476266] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.477051] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.477051] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.477051] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.477051] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.486174] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d79a9e34-ff20-4d67-b0ec-c75b2bb20610 in Status: IN_PROGRESS for 2s [ 780.505601] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.505601] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.505601] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.505601] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.505601] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.521206] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 in Status: IN_PROGRESS for 2s [ 780.717209] env[70392]: INFO networking_nsxv3.common.synchronization [req-805e5da1-9d93-4dde-8dc9-ef6de61e0741 req-d3c863c4-6912-4c92-bb54-fb92d021006e tempest-TenantUsagesTestJSON-121259612 tempest-TenantUsagesTestJSON-121259612-project-member] Enqueued Resource ID: b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f with Priority: HIGHEST for action security_group_members [ 780.721886] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f with Priority: HIGHEST for action security_group_members [ 780.721886] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.721886] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.721886] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.721886] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.721886] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.721886] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.721886] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.721886] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.721886] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.721886] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.878215] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.878215] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.878324] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.878710] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.879271] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.879692] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 87729ccf-b5c1-4c71-b616-13269541067e is going to be updated. [ 780.911207] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.911583] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.911583] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.911750] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.911930] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.924540] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87729ccf-b5c1-4c71-b616-13269541067e in Status: IN_PROGRESS for 2s [ 781.223745] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.223745] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.223745] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.224195] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.224195] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.226039] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.226039] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.226039] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.226039] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.226039] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.226039] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f already deleted. [ 781.226039] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.330994] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-325 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.335024] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-325" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.335024] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-325" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.335024] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-325" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.335024] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.335024] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.335024] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.335024] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.335024] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.335024] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 781.335024] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 781.335024] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 781.335024] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 781.335024] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 781.335024] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 781.335614] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 781.355754] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 781.356088] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 781.356217] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 781.356416] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-325" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.356794] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-73730be8-7ba1-4fd4-a774-65baa37ef486 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.356978] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-73730be8-7ba1-4fd4-a774-65baa37ef486" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.357116] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-73730be8-7ba1-4fd4-a774-65baa37ef486" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.357478] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-73730be8-7ba1-4fd4-a774-65baa37ef486" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.357622] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73730be8-7ba1-4fd4-a774-65baa37ef486',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.863782] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.864041] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.864174] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.864464] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.864668] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.864779] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 73730be8-7ba1-4fd4-a774-65baa37ef486 not found, creating... [ 781.865294] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.865458] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.865579] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.865891] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.866103] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.866564] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.866754] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.866804] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.867183] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.867183] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.867291] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 73730be8-7ba1-4fd4-a774-65baa37ef486 is going to be created. [ 781.893158] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.893325] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.893449] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.893713] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.895040] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.895040] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-73730be8-7ba1-4fd4-a774-65baa37ef486" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.497701] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d79a9e34-ff20-4d67-b0ec-c75b2bb20610 in Status: SUCCESS [ 782.497983] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d79a9e34-ff20-4d67-b0ec-c75b2bb20610" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.500667] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d79a9e34-ff20-4d67-b0ec-c75b2bb20610" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.500869] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d79a9e34-ff20-4d67-b0ec-c75b2bb20610" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.501178] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.501270] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.501313] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.501452] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.501611] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.501611] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d79a9e34-ff20-4d67-b0ec-c75b2bb20610" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.501777] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-d79a9e34-ff20-4d67-b0ec-c75b2bb20610 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.501966] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d79a9e34-ff20-4d67-b0ec-c75b2bb20610" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.501966] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d79a9e34-ff20-4d67-b0ec-c75b2bb20610" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.502132] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d79a9e34-ff20-4d67-b0ec-c75b2bb20610" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.502186] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.502484] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.502545] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.502812] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.502812] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.502897] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d79a9e34-ff20-4d67-b0ec-c75b2bb20610" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.502983] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d79a9e34-ff20-4d67-b0ec-c75b2bb20610',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.505810] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d79a9e34-ff20-4d67-b0ec-c75b2bb20610" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.507157] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d79a9e34-ff20-4d67-b0ec-c75b2bb20610" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.507331] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.507436] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.507504] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.507656] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.507780] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.507818] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d79a9e34-ff20-4d67-b0ec-c75b2bb20610',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.543647] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 in Status: SUCCESS [ 782.543922] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.933644] env[70392]: INFO networking_nsxv3.common.synchronization [req-805e5da1-9d93-4dde-8dc9-ef6de61e0741 req-56c00d54-3a71-4d1a-88f7-6166dc1cc8e7 service nova] Enqueued Resource ID: b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f with Priority: HIGHEST for action security_group_rules [ 782.933833] env[70392]: INFO networking_nsxv3.common.synchronization [req-805e5da1-9d93-4dde-8dc9-ef6de61e0741 req-56c00d54-3a71-4d1a-88f7-6166dc1cc8e7 service nova] Enqueued Resource ID: b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f with Priority: HIGHEST for action security_group_members [ 782.933969] env[70392]: INFO networking_nsxv3.common.synchronization [req-805e5da1-9d93-4dde-8dc9-ef6de61e0741 req-56c00d54-3a71-4d1a-88f7-6166dc1cc8e7 service nova] Enqueued Resource ID: 73730be8-7ba1-4fd4-a774-65baa37ef486 with Priority: HIGHEST for action port [ 782.937536] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f with Priority: HIGHEST for action security_group_rules [ 782.937536] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f with Priority: HIGHEST for action security_group_members [ 782.937536] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73730be8-7ba1-4fd4-a774-65baa37ef486 with Priority: HIGHEST for action port [ 782.940447] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87729ccf-b5c1-4c71-b616-13269541067e in Status: SUCCESS [ 782.940936] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87729ccf-b5c1-4c71-b616-13269541067e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.940936] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.940936] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.941264] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.942425] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.942425] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.942425] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.942425] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.942636] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.942636] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.942810] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.942881] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.942923] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.943486] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.943486] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.943486] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.944995] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-73730be8-7ba1-4fd4-a774-65baa37ef486 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.944995] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-73730be8-7ba1-4fd4-a774-65baa37ef486" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.944995] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-73730be8-7ba1-4fd4-a774-65baa37ef486" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.944995] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-73730be8-7ba1-4fd4-a774-65baa37ef486" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.944995] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73730be8-7ba1-4fd4-a774-65baa37ef486',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.946490] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87729ccf-b5c1-4c71-b616-13269541067e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.946721] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87729ccf-b5c1-4c71-b616-13269541067e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.947209] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.947369] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.947459] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.947635] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.947746] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.947858] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87729ccf-b5c1-4c71-b616-13269541067e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.947961] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('87729ccf-b5c1-4c71-b616-13269541067e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.007626] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d79a9e34-ff20-4d67-b0ec-c75b2bb20610: rpc.has_security_group_logging(os_id): False [ 783.014629] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.015233] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.015321] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.015539] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.039755] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.039897] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.042637] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.042898] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.043052] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.043151] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.043315] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.043396] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.043491] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d79a9e34-ff20-4d67-b0ec-c75b2bb20610 is going to be updated. [ 783.044477] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.044684] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.044738] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.045347] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.045347] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.045347] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.045347] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.045714] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.045714] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.045714] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.045714] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.046023] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.046023] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.046695] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.046831] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.046946] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.047033] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.047114] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.047211] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d79a9e34-ff20-4d67-b0ec-c75b2bb20610 is going to be updated. [ 783.083243] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.083991] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.083991] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.083991] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.083991] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.094182] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d79a9e34-ff20-4d67-b0ec-c75b2bb20610 in Status: IN_PROGRESS for 2s [ 783.138306] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.138464] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.138518] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.138759] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.139070] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.163362] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d79a9e34-ff20-4d67-b0ec-c75b2bb20610 in Status: IN_PROGRESS for 2s [ 783.449753] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 73730be8-7ba1-4fd4-a774-65baa37ef486 with status ACTIVE [ 783.453828] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.453828] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.453828] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.453828] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.453828] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.453828] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.453828] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.453828] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.453828] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.453828] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.453828] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.453828] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.453828] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.453828] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.453828] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.453828] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 73730be8-7ba1-4fd4-a774-65baa37ef486 is going to be updated. [ 783.454612] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.454612] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.454612] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.454894] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-87729ccf-b5c1-4c71-b616-13269541067e taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.455024] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87729ccf-b5c1-4c71-b616-13269541067e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.455024] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87729ccf-b5c1-4c71-b616-13269541067e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.455158] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87729ccf-b5c1-4c71-b616-13269541067e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.455298] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.455385] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.455444] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.455580] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.455652] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.455727] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87729ccf-b5c1-4c71-b616-13269541067e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.455860] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-87729ccf-b5c1-4c71-b616-13269541067e taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.455945] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87729ccf-b5c1-4c71-b616-13269541067e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.455998] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87729ccf-b5c1-4c71-b616-13269541067e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.456142] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87729ccf-b5c1-4c71-b616-13269541067e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.456269] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.456353] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.456410] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.456538] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.456623] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.456763] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87729ccf-b5c1-4c71-b616-13269541067e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.456851] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('87729ccf-b5c1-4c71-b616-13269541067e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.482812] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.483314] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.483314] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.483314] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.483459] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.483623] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-73730be8-7ba1-4fd4-a774-65baa37ef486" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.959417] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.962928] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 87729ccf-b5c1-4c71-b616-13269541067e: rpc.has_security_group_logging(os_id): False [ 783.987820] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.988041] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.988890] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.989190] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.013368] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.013536] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.013652] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.013720] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.013920] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.014072] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.014357] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.014465] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.014465] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.015252] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.016482] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.016482] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.016482] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.016482] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.016482] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.016706] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.016706] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 87729ccf-b5c1-4c71-b616-13269541067e is going to be updated. [ 784.101156] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.101312] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.101448] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.101931] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.101931] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.114648] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 87729ccf-b5c1-4c71-b616-13269541067e in Status: IN_PROGRESS for 2s [ 784.165454] env[70392]: INFO networking_nsxv3.common.synchronization [req-57ed5a24-ef08-4db5-825f-d97e95c6eb1b req-496a5573-5c8d-4630-8986-6ba69c8ca35f tempest-ServerDiagnosticsNegativeTest-997856407 tempest-ServerDiagnosticsNegativeTest-997856407-project-member] Enqueued Resource ID: c6ed4920-0e6a-4b44-ab86-2e2af45392fb with Priority: HIGHEST for action security_group_members [ 784.168919] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6ed4920-0e6a-4b44-ab86-2e2af45392fb with Priority: HIGHEST for action security_group_members [ 784.168919] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6ed4920-0e6a-4b44-ab86-2e2af45392fb taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.168919] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6ed4920-0e6a-4b44-ab86-2e2af45392fb" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.168919] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6ed4920-0e6a-4b44-ab86-2e2af45392fb" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.168919] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6ed4920-0e6a-4b44-ab86-2e2af45392fb" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.168919] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.168919] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.168919] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.168919] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.168919] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.168919] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6ed4920-0e6a-4b44-ab86-2e2af45392fb',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.387689] env[70392]: INFO networking_nsxv3.common.synchronization [None req-ce059c23-282d-4b37-be6e-48c94c009ffe None None] Enqueued Resource ID: 30c5a7a6-8de6-4886-840d-1b6718291eab with Priority: HIGHEST for action port [ 784.392109] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30c5a7a6-8de6-4886-840d-1b6718291eab with Priority: HIGHEST for action port [ 784.392109] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-30c5a7a6-8de6-4886-840d-1b6718291eab taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.392109] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-30c5a7a6-8de6-4886-840d-1b6718291eab" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.392109] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-30c5a7a6-8de6-4886-840d-1b6718291eab" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.392109] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-30c5a7a6-8de6-4886-840d-1b6718291eab" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.392353] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('30c5a7a6-8de6-4886-840d-1b6718291eab',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.461436] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.462013] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.462013] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.462013] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.463339] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.463414] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f is going to be created. [ 784.492734] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.493009] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.493202] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.493451] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.493664] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.508716] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f in Status: UNINITIALIZED for 2s [ 784.526236] env[70392]: INFO networking_nsxv3.common.synchronization [None req-d46bfc02-c3f5-40e6-a9c6-5a506bab5e46 None None] Enqueued Resource ID: 9d1a3ca7-082c-4463-a322-dd48fa8a5f5c with Priority: HIGHEST for action port [ 784.526524] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d1a3ca7-082c-4463-a322-dd48fa8a5f5c with Priority: HIGHEST for action port [ 784.527104] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d1a3ca7-082c-4463-a322-dd48fa8a5f5c taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.527451] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d1a3ca7-082c-4463-a322-dd48fa8a5f5c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.527451] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d1a3ca7-082c-4463-a322-dd48fa8a5f5c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.527553] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d1a3ca7-082c-4463-a322-dd48fa8a5f5c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.527637] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d1a3ca7-082c-4463-a322-dd48fa8a5f5c',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.674318] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.674318] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.674318] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.674318] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.674318] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.674318] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.674318] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.674318] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.674318] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.674318] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.674318] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6ed4920-0e6a-4b44-ab86-2e2af45392fb is going to be updated. [ 784.737901] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.738065] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.738138] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.738705] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.738705] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.758613] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6ed4920-0e6a-4b44-ab86-2e2af45392fb in Status: IN_PROGRESS for 2s [ 784.893891] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 30c5a7a6-8de6-4886-840d-1b6718291eab [ 784.894990] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.894990] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.894990] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.894990] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.894990] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.894990] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:30c5a7a6-8de6-4886-840d-1b6718291eab already deleted. [ 784.894990] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-30c5a7a6-8de6-4886-840d-1b6718291eab" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.032295] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9d1a3ca7-082c-4463-a322-dd48fa8a5f5c [ 785.032295] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.032295] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.032295] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.032295] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.032295] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.032295] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9d1a3ca7-082c-4463-a322-dd48fa8a5f5c already deleted. [ 785.032295] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d1a3ca7-082c-4463-a322-dd48fa8a5f5c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.105558] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d79a9e34-ff20-4d67-b0ec-c75b2bb20610 in Status: SUCCESS [ 785.105558] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d79a9e34-ff20-4d67-b0ec-c75b2bb20610 deletion is rescheduled due to dependency. [ 785.105558] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d79a9e34-ff20-4d67-b0ec-c75b2bb20610" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.179462] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d79a9e34-ff20-4d67-b0ec-c75b2bb20610 in Status: SUCCESS [ 785.179462] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d79a9e34-ff20-4d67-b0ec-c75b2bb20610" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.179462] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d79a9e34-ff20-4d67-b0ec-c75b2bb20610" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.179462] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d79a9e34-ff20-4d67-b0ec-c75b2bb20610" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.179462] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d79a9e34-ff20-4d67-b0ec-c75b2bb20610',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.700497] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.701740] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.701740] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.701740] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.701740] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.701740] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d79a9e34-ff20-4d67-b0ec-c75b2bb20610 is going to be deleted. [ 785.766714] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.766714] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.766714] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.766714] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.766714] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.766714] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d79a9e34-ff20-4d67-b0ec-c75b2bb20610" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.771630] env[70392]: INFO networking_nsxv3.common.synchronization [req-c484fad9-8ba6-479e-9427-84ecfdc56be1 req-3d725c03-717a-4581-a9be-77228a984251 tempest-ServerPasswordTestJSON-1253827618 tempest-ServerPasswordTestJSON-1253827618-project-member] Enqueued Resource ID: 0ff592de-806a-4492-9791-c0de60e8c15a with Priority: HIGHEST for action security_group_members [ 785.772201] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ff592de-806a-4492-9791-c0de60e8c15a with Priority: HIGHEST for action security_group_members [ 785.772499] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ff592de-806a-4492-9791-c0de60e8c15a taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.772612] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ff592de-806a-4492-9791-c0de60e8c15a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.772674] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ff592de-806a-4492-9791-c0de60e8c15a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.773017] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ff592de-806a-4492-9791-c0de60e8c15a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.776290] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.776290] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.776290] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.776290] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.776290] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.776290] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ff592de-806a-4492-9791-c0de60e8c15a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.124773] env[70392]: INFO networking_nsxv3.common.synchronization [None req-354a9437-d6ae-452d-b377-c0794ee8a5e2 tempest-AttachInterfacesUnderV243Test-202360309 tempest-AttachInterfacesUnderV243Test-202360309-project-member] Enqueued Resource ID: 12c8b5a9-023e-43d6-a4a6-03004d0ac434 with Priority: HIGHEST for action security_group_rules [ 786.125351] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12c8b5a9-023e-43d6-a4a6-03004d0ac434 with Priority: HIGHEST for action security_group_rules [ 786.125690] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-12c8b5a9-023e-43d6-a4a6-03004d0ac434 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.125807] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-12c8b5a9-023e-43d6-a4a6-03004d0ac434" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.125873] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-12c8b5a9-023e-43d6-a4a6-03004d0ac434" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.129578] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-12c8b5a9-023e-43d6-a4a6-03004d0ac434" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.129649] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('12c8b5a9-023e-43d6-a4a6-03004d0ac434',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.132865] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 87729ccf-b5c1-4c71-b616-13269541067e in Status: SUCCESS [ 786.133100] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-87729ccf-b5c1-4c71-b616-13269541067e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.279465] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.279465] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.280873] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.280873] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.280873] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.280873] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.280873] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.280873] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.281180] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.281180] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.281259] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ff592de-806a-4492-9791-c0de60e8c15a already deleted. [ 786.281305] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ff592de-806a-4492-9791-c0de60e8c15a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.295502] env[70392]: INFO networking_nsxv3.common.synchronization [None req-d1467e6f-2096-4897-9eda-4efce38a23ea tempest-ServersTestBootFromVolume-2123411636 tempest-ServersTestBootFromVolume-2123411636-project-member] Enqueued Resource ID: db50a8fd-2283-44bb-910d-f7a2f2541f14 with Priority: HIGHEST for action security_group_rules [ 786.296040] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db50a8fd-2283-44bb-910d-f7a2f2541f14 with Priority: HIGHEST for action security_group_rules [ 786.296333] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-db50a8fd-2283-44bb-910d-f7a2f2541f14 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.296447] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-db50a8fd-2283-44bb-910d-f7a2f2541f14" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.296510] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-db50a8fd-2283-44bb-910d-f7a2f2541f14" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.296788] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-db50a8fd-2283-44bb-910d-f7a2f2541f14" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.296863] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('db50a8fd-2283-44bb-910d-f7a2f2541f14',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.314591] env[70392]: INFO networking_nsxv3.common.synchronization [None req-5523be7f-10aa-4da6-ba67-380edf878508 tempest-AttachInterfacesUnderV243Test-202360309 tempest-AttachInterfacesUnderV243Test-202360309-project-member] Enqueued Resource ID: 12c8b5a9-023e-43d6-a4a6-03004d0ac434 with Priority: HIGHEST for action security_group_rules [ 786.315285] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12c8b5a9-023e-43d6-a4a6-03004d0ac434 with Priority: HIGHEST for action security_group_rules [ 786.315483] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-12c8b5a9-023e-43d6-a4a6-03004d0ac434 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.315594] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-12c8b5a9-023e-43d6-a4a6-03004d0ac434" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.507832] env[70392]: INFO networking_nsxv3.common.synchronization [None req-da52f853-2797-4864-b8e9-0cd59da263b9 tempest-ServersTestBootFromVolume-2123411636 tempest-ServersTestBootFromVolume-2123411636-project-member] Enqueued Resource ID: db50a8fd-2283-44bb-910d-f7a2f2541f14 with Priority: HIGHEST for action security_group_rules [ 786.508638] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db50a8fd-2283-44bb-910d-f7a2f2541f14 with Priority: HIGHEST for action security_group_rules [ 786.511526] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-db50a8fd-2283-44bb-910d-f7a2f2541f14 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.511670] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-db50a8fd-2283-44bb-910d-f7a2f2541f14" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.525540] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f in Status: SUCCESS [ 786.525540] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.525540] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.525658] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.525801] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.525915] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.525981] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.526156] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.526237] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.526324] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.526417] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.593151] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-375 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.593849] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-375" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.593849] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-375" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.593977] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-375" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.594833] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.594833] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.594833] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.594833] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.595085] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.598519] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 786.598714] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 786.599059] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 786.599223] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 786.599337] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 786.599457] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 786.599620] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 786.627231] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 786.627519] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 786.627861] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 786.628147] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-375" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.628753] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-bd2c8a0c-737f-4bd2-b4aa-7deca422e9e7 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.629201] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-bd2c8a0c-737f-4bd2-b4aa-7deca422e9e7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.629387] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-bd2c8a0c-737f-4bd2-b4aa-7deca422e9e7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.629797] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-bd2c8a0c-737f-4bd2-b4aa-7deca422e9e7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.630072] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd2c8a0c-737f-4bd2-b4aa-7deca422e9e7',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.645001] env[70392]: INFO networking_nsxv3.common.synchronization [None req-7ac77c79-78d8-42ea-8eaf-cdc6822ca925 None None] Enqueued Resource ID: e1f04323-6164-4cd0-b0a3-834670a9904b with Priority: HIGHEST for action port [ 786.645458] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1f04323-6164-4cd0-b0a3-834670a9904b with Priority: HIGHEST for action port [ 786.647045] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-e1f04323-6164-4cd0-b0a3-834670a9904b taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.647045] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e1f04323-6164-4cd0-b0a3-834670a9904b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.647045] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e1f04323-6164-4cd0-b0a3-834670a9904b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.647308] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e1f04323-6164-4cd0-b0a3-834670a9904b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.647394] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e1f04323-6164-4cd0-b0a3-834670a9904b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.661497] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.661497] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.661497] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.661497] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.661497] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.661679] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 12c8b5a9-023e-43d6-a4a6-03004d0ac434 already deleted. [ 786.661679] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-12c8b5a9-023e-43d6-a4a6-03004d0ac434" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.663020] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-12c8b5a9-023e-43d6-a4a6-03004d0ac434" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.663020] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-12c8b5a9-023e-43d6-a4a6-03004d0ac434" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.663020] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('12c8b5a9-023e-43d6-a4a6-03004d0ac434',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.772951] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6ed4920-0e6a-4b44-ab86-2e2af45392fb in Status: SUCCESS [ 786.773358] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6ed4920-0e6a-4b44-ab86-2e2af45392fb deletion is rescheduled due to dependency. [ 786.773358] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6ed4920-0e6a-4b44-ab86-2e2af45392fb" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.806195] env[70392]: INFO networking_nsxv3.common.synchronization [None req-43ae7424-9e5b-4ec8-9bd8-9778e39e3558 None None] Enqueued Resource ID: 57899461-8b64-4cf9-bd2b-5120737627c8 with Priority: HIGHEST for action port [ 786.808740] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57899461-8b64-4cf9-bd2b-5120737627c8 with Priority: HIGHEST for action port [ 786.811534] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-57899461-8b64-4cf9-bd2b-5120737627c8 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.811534] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-57899461-8b64-4cf9-bd2b-5120737627c8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.811534] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-57899461-8b64-4cf9-bd2b-5120737627c8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.811534] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-57899461-8b64-4cf9-bd2b-5120737627c8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.811534] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57899461-8b64-4cf9-bd2b-5120737627c8',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.828999] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.828999] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.828999] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.829303] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.830034] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.830034] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: db50a8fd-2283-44bb-910d-f7a2f2541f14 already deleted. [ 786.830034] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-db50a8fd-2283-44bb-910d-f7a2f2541f14" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.832644] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-db50a8fd-2283-44bb-910d-f7a2f2541f14" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.832644] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-db50a8fd-2283-44bb-910d-f7a2f2541f14" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.832644] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('db50a8fd-2283-44bb-910d-f7a2f2541f14',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.029474] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.029827] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.030084] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.030397] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.030669] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.030880] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.031178] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.031318] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.031521] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.031725] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.031860] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.031972] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.032074] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.032224] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.032425] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.032485] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.032548] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.032725] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.034010] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.034173] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.035010] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.134902] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.135246] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.135283] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.135613] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.135779] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.135970] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port bd2c8a0c-737f-4bd2-b4aa-7deca422e9e7 not found, creating... [ 787.136351] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.136589] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.136804] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.137224] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.137328] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.137680] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.137936] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.139270] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.139618] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.139806] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.140212] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: bd2c8a0c-737f-4bd2-b4aa-7deca422e9e7 is going to be created. [ 787.153757] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e1f04323-6164-4cd0-b0a3-834670a9904b [ 787.154256] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.154256] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.154409] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.155087] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.155087] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.155087] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e1f04323-6164-4cd0-b0a3-834670a9904b already deleted. [ 787.155087] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e1f04323-6164-4cd0-b0a3-834670a9904b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.169290] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.170029] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.170029] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.170029] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.171617] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.172917] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-bd2c8a0c-737f-4bd2-b4aa-7deca422e9e7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.204397] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.205449] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.205449] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.205449] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.205449] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.205449] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 12c8b5a9-023e-43d6-a4a6-03004d0ac434 already deleted. [ 787.205449] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-12c8b5a9-023e-43d6-a4a6-03004d0ac434" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.314428] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 57899461-8b64-4cf9-bd2b-5120737627c8 [ 787.314428] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.314428] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.314428] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.314428] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.314428] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.314428] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:57899461-8b64-4cf9-bd2b-5120737627c8 already deleted. [ 787.314428] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-57899461-8b64-4cf9-bd2b-5120737627c8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.355080] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.355841] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.356148] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.356446] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.356640] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.357534] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: db50a8fd-2283-44bb-910d-f7a2f2541f14 already deleted. [ 787.357534] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-db50a8fd-2283-44bb-910d-f7a2f2541f14" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.538410] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f: rpc.has_security_group_logging(os_id): False [ 787.557326] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.557558] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.557558] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.557994] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.557994] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.557994] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.558168] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.558168] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.558395] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.558395] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.558511] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.558756] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.558756] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.558900] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.558900] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.559097] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.559178] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.559226] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.559364] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.559430] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.559512] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f is going to be created. [ 787.672427] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.672588] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.672670] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.672899] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.673118] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.690926] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f in Status: IN_PROGRESS for 2s [ 788.249072] env[70392]: INFO networking_nsxv3.common.synchronization [req-c484fad9-8ba6-479e-9427-84ecfdc56be1 req-1c224d9e-e91f-47d8-9bdc-5f0138ba360a service nova] Enqueued Resource ID: 0ff592de-806a-4492-9791-c0de60e8c15a with Priority: HIGHEST for action security_group_rules [ 788.249387] env[70392]: INFO networking_nsxv3.common.synchronization [req-c484fad9-8ba6-479e-9427-84ecfdc56be1 req-1c224d9e-e91f-47d8-9bdc-5f0138ba360a service nova] Enqueued Resource ID: 0ff592de-806a-4492-9791-c0de60e8c15a with Priority: HIGHEST for action security_group_members [ 788.249454] env[70392]: INFO networking_nsxv3.common.synchronization [req-c484fad9-8ba6-479e-9427-84ecfdc56be1 req-1c224d9e-e91f-47d8-9bdc-5f0138ba360a service nova] Enqueued Resource ID: bd2c8a0c-737f-4bd2-b4aa-7deca422e9e7 with Priority: HIGHEST for action port [ 788.249731] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ff592de-806a-4492-9791-c0de60e8c15a with Priority: HIGHEST for action security_group_rules [ 788.251347] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ff592de-806a-4492-9791-c0de60e8c15a with Priority: HIGHEST for action security_group_members [ 788.251347] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd2c8a0c-737f-4bd2-b4aa-7deca422e9e7 with Priority: HIGHEST for action port [ 788.251347] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ff592de-806a-4492-9791-c0de60e8c15a taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.251347] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ff592de-806a-4492-9791-c0de60e8c15a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.251347] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ff592de-806a-4492-9791-c0de60e8c15a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.251347] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ff592de-806a-4492-9791-c0de60e8c15a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.251347] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ff592de-806a-4492-9791-c0de60e8c15a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.251983] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ff592de-806a-4492-9791-c0de60e8c15a taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.252120] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ff592de-806a-4492-9791-c0de60e8c15a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.252189] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ff592de-806a-4492-9791-c0de60e8c15a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.252389] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ff592de-806a-4492-9791-c0de60e8c15a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.252569] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.252690] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.253275] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.253275] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.253275] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.253275] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ff592de-806a-4492-9791-c0de60e8c15a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.254517] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-bd2c8a0c-737f-4bd2-b4aa-7deca422e9e7 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.254623] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bd2c8a0c-737f-4bd2-b4aa-7deca422e9e7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.255284] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bd2c8a0c-737f-4bd2-b4aa-7deca422e9e7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.255284] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bd2c8a0c-737f-4bd2-b4aa-7deca422e9e7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.255284] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd2c8a0c-737f-4bd2-b4aa-7deca422e9e7',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.444310] env[70392]: INFO networking_nsxv3.common.synchronization [None req-2f22fa58-fa25-47b4-bcb6-d1f4a4b12583 None None] Enqueued Resource ID: 3f830986-3080-42e3-9121-c686159b2a7b with Priority: HIGHEST for action port [ 788.445496] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f830986-3080-42e3-9121-c686159b2a7b with Priority: HIGHEST for action port [ 788.445725] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-3f830986-3080-42e3-9121-c686159b2a7b taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.446056] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3f830986-3080-42e3-9121-c686159b2a7b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.446056] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3f830986-3080-42e3-9121-c686159b2a7b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.446161] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3f830986-3080-42e3-9121-c686159b2a7b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.446253] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3f830986-3080-42e3-9121-c686159b2a7b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.761021] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0ff592de-806a-4492-9791-c0de60e8c15a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.761021] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ff592de-806a-4492-9791-c0de60e8c15a taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.761021] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ff592de-806a-4492-9791-c0de60e8c15a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.761021] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bd2c8a0c-737f-4bd2-b4aa-7deca422e9e7 with status ACTIVE [ 788.761021] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.761021] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.761021] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.761021] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.761021] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.761021] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.761021] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.761021] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.762030] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.762213] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.762502] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.762746] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.762934] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.763199] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.763383] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.763547] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bd2c8a0c-737f-4bd2-b4aa-7deca422e9e7 is going to be updated. [ 788.789503] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.789503] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.789503] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.789503] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.789503] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.789503] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bd2c8a0c-737f-4bd2-b4aa-7deca422e9e7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.949648] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3f830986-3080-42e3-9121-c686159b2a7b [ 788.951418] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.951418] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.951418] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.951418] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.951418] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.951418] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3f830986-3080-42e3-9121-c686159b2a7b already deleted. [ 788.951418] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3f830986-3080-42e3-9121-c686159b2a7b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.260576] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0ff592de-806a-4492-9791-c0de60e8c15a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.755380] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f in Status: SUCCESS [ 789.755604] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.765668] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.765856] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.765856] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.766310] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.766310] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.766310] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ff592de-806a-4492-9791-c0de60e8c15a is going to be created. [ 789.814183] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.814376] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.814376] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.814648] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.814814] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.833936] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ff592de-806a-4492-9791-c0de60e8c15a in Status: UNINITIALIZED for 2s [ 790.691895] env[70392]: INFO networking_nsxv3.common.synchronization [None req-8754b313-c6e4-4d7c-93af-67a44dce6036 None None] Enqueued Resource ID: 30f26194-a27b-474c-932a-8ff0af29ba14 with Priority: HIGHEST for action port [ 790.691895] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30f26194-a27b-474c-932a-8ff0af29ba14 with Priority: HIGHEST for action port [ 790.691895] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-30f26194-a27b-474c-932a-8ff0af29ba14 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.691895] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-30f26194-a27b-474c-932a-8ff0af29ba14" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.691895] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-30f26194-a27b-474c-932a-8ff0af29ba14" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.692226] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-30f26194-a27b-474c-932a-8ff0af29ba14" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.692226] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('30f26194-a27b-474c-932a-8ff0af29ba14',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.934476] env[70392]: INFO networking_nsxv3.common.synchronization [req-de535d54-9635-400c-8008-763ff2351418 req-148d9af9-f5ca-49a5-b759-04d0ddf8b823 tempest-ServerActionsV293TestJSON-2036472382 tempest-ServerActionsV293TestJSON-2036472382-project-member] Enqueued Resource ID: 44698b7f-7125-46d0-837f-5d44d3ee1aea with Priority: HIGHEST for action security_group_members [ 790.934476] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44698b7f-7125-46d0-837f-5d44d3ee1aea with Priority: HIGHEST for action security_group_members [ 790.934770] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-44698b7f-7125-46d0-837f-5d44d3ee1aea taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.934770] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44698b7f-7125-46d0-837f-5d44d3ee1aea" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.934948] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44698b7f-7125-46d0-837f-5d44d3ee1aea" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.935134] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44698b7f-7125-46d0-837f-5d44d3ee1aea" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.935297] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.935400] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.935462] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.935620] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.935707] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.935801] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44698b7f-7125-46d0-837f-5d44d3ee1aea',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.194356] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 30f26194-a27b-474c-932a-8ff0af29ba14 [ 791.194643] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.194807] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.194898] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.195250] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.195287] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.195374] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:30f26194-a27b-474c-932a-8ff0af29ba14 already deleted. [ 791.195482] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-30f26194-a27b-474c-932a-8ff0af29ba14" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.440598] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.440774] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.440852] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.441084] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.441202] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.445028] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.445028] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.445028] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.445028] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.445028] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.445028] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44698b7f-7125-46d0-837f-5d44d3ee1aea already deleted. [ 791.445028] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44698b7f-7125-46d0-837f-5d44d3ee1aea" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.569259] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-380 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.573037] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-380" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.573037] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-380" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.573037] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-380" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.573037] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.573037] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.573037] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.573037] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.573037] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.573037] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 791.573037] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 791.573037] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 791.573037] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 791.573037] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 791.573037] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 791.573037] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 791.592838] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 791.593008] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 791.593150] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 791.593324] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-380" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.593630] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-bf62b565-21b0-43e9-acad-8a7ae2d81da1 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.593792] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-bf62b565-21b0-43e9-acad-8a7ae2d81da1" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.593914] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-bf62b565-21b0-43e9-acad-8a7ae2d81da1" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.594302] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-bf62b565-21b0-43e9-acad-8a7ae2d81da1" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.594440] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf62b565-21b0-43e9-acad-8a7ae2d81da1',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.845521] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ff592de-806a-4492-9791-c0de60e8c15a in Status: SUCCESS [ 791.845905] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ff592de-806a-4492-9791-c0de60e8c15a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.845905] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ff592de-806a-4492-9791-c0de60e8c15a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.846224] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ff592de-806a-4492-9791-c0de60e8c15a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.846418] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.846543] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.846609] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.846770] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.847502] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.847502] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ff592de-806a-4492-9791-c0de60e8c15a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.847502] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0ff592de-806a-4492-9791-c0de60e8c15a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.097698] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.097698] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.097698] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.097999] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.098190] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.098439] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port bf62b565-21b0-43e9-acad-8a7ae2d81da1 not found, creating... [ 792.099156] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.099156] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.099156] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.099375] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.099526] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.099846] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.100125] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.101089] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.101089] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.101089] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.101089] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: bf62b565-21b0-43e9-acad-8a7ae2d81da1 is going to be created. [ 792.121951] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.122249] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.123826] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.123826] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.123826] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.123826] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-bf62b565-21b0-43e9-acad-8a7ae2d81da1" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.351151] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ff592de-806a-4492-9791-c0de60e8c15a taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.351151] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ff592de-806a-4492-9791-c0de60e8c15a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.351151] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ff592de-806a-4492-9791-c0de60e8c15a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.351401] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ff592de-806a-4492-9791-c0de60e8c15a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.351430] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.351562] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.351659] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.351764] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.351877] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.351970] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ff592de-806a-4492-9791-c0de60e8c15a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.352141] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ff592de-806a-4492-9791-c0de60e8c15a taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.352235] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ff592de-806a-4492-9791-c0de60e8c15a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.352292] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ff592de-806a-4492-9791-c0de60e8c15a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.352432] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ff592de-806a-4492-9791-c0de60e8c15a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.352563] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.352649] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.352705] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.352837] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.352913] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.352994] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ff592de-806a-4492-9791-c0de60e8c15a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.353112] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0ff592de-806a-4492-9791-c0de60e8c15a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.856663] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0ff592de-806a-4492-9791-c0de60e8c15a: rpc.has_security_group_logging(os_id): False [ 792.877976] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.877976] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.878104] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.878220] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.878360] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.878487] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.878584] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.878645] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.878789] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.878861] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.879097] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.879196] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.879255] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.879395] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.879467] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.879645] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.879734] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.879793] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.879927] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.881493] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.882159] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ff592de-806a-4492-9791-c0de60e8c15a is going to be created. [ 792.950371] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.950953] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.950953] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.950953] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.951157] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.962940] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ff592de-806a-4492-9791-c0de60e8c15a in Status: IN_PROGRESS for 2s [ 793.191202] env[70392]: INFO networking_nsxv3.common.synchronization [req-de535d54-9635-400c-8008-763ff2351418 req-8787478e-c2c6-4141-b23e-db63e54d2504 service nova] Enqueued Resource ID: 44698b7f-7125-46d0-837f-5d44d3ee1aea with Priority: HIGHEST for action security_group_rules [ 793.191532] env[70392]: INFO networking_nsxv3.common.synchronization [req-de535d54-9635-400c-8008-763ff2351418 req-8787478e-c2c6-4141-b23e-db63e54d2504 service nova] Enqueued Resource ID: 44698b7f-7125-46d0-837f-5d44d3ee1aea with Priority: HIGHEST for action security_group_members [ 793.191770] env[70392]: INFO networking_nsxv3.common.synchronization [req-de535d54-9635-400c-8008-763ff2351418 req-8787478e-c2c6-4141-b23e-db63e54d2504 service nova] Enqueued Resource ID: bf62b565-21b0-43e9-acad-8a7ae2d81da1 with Priority: HIGHEST for action port [ 793.192548] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44698b7f-7125-46d0-837f-5d44d3ee1aea with Priority: HIGHEST for action security_group_rules [ 793.192695] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44698b7f-7125-46d0-837f-5d44d3ee1aea with Priority: HIGHEST for action security_group_members [ 793.192789] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf62b565-21b0-43e9-acad-8a7ae2d81da1 with Priority: HIGHEST for action port [ 793.195968] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-44698b7f-7125-46d0-837f-5d44d3ee1aea taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.196152] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-44698b7f-7125-46d0-837f-5d44d3ee1aea" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.196228] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-44698b7f-7125-46d0-837f-5d44d3ee1aea" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.196457] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-44698b7f-7125-46d0-837f-5d44d3ee1aea" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.196541] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('44698b7f-7125-46d0-837f-5d44d3ee1aea',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.197561] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-44698b7f-7125-46d0-837f-5d44d3ee1aea taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.197677] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44698b7f-7125-46d0-837f-5d44d3ee1aea" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.197741] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44698b7f-7125-46d0-837f-5d44d3ee1aea" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.197937] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44698b7f-7125-46d0-837f-5d44d3ee1aea" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.198145] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.198253] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.198337] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.198495] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.198595] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.198679] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44698b7f-7125-46d0-837f-5d44d3ee1aea',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.204294] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf62b565-21b0-43e9-acad-8a7ae2d81da1 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.204560] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf62b565-21b0-43e9-acad-8a7ae2d81da1" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.204560] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf62b565-21b0-43e9-acad-8a7ae2d81da1" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.206020] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf62b565-21b0-43e9-acad-8a7ae2d81da1" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.206020] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf62b565-21b0-43e9-acad-8a7ae2d81da1',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.706683] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-44698b7f-7125-46d0-837f-5d44d3ee1aea taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.709169] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44698b7f-7125-46d0-837f-5d44d3ee1aea" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.709169] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('44698b7f-7125-46d0-837f-5d44d3ee1aea',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.709999] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bf62b565-21b0-43e9-acad-8a7ae2d81da1 with status ACTIVE [ 793.710334] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.710514] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.710620] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.710919] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.711330] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.711404] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.711527] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.711624] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.711885] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.712013] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.714063] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.714063] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.714063] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.714063] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.714063] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.714063] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bf62b565-21b0-43e9-acad-8a7ae2d81da1 is going to be updated. [ 793.745164] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.745316] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.745389] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.745605] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.745747] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.747429] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf62b565-21b0-43e9-acad-8a7ae2d81da1" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.218184] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('44698b7f-7125-46d0-837f-5d44d3ee1aea',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.720756] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.721022] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.721022] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.721212] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.721488] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.721615] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44698b7f-7125-46d0-837f-5d44d3ee1aea is going to be created. [ 794.746183] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.746343] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.746410] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.746593] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.746749] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.758483] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44698b7f-7125-46d0-837f-5d44d3ee1aea in Status: UNINITIALIZED for 2s [ 794.976063] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ff592de-806a-4492-9791-c0de60e8c15a in Status: SUCCESS [ 794.976063] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ff592de-806a-4492-9791-c0de60e8c15a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.804870] env[70392]: INFO networking_nsxv3.common.synchronization [req-fb4ed702-858e-4904-a958-ffb9cb3ada50 req-9d740967-7357-4d80-8d81-b0d4d7bf9e33 tempest-DeleteServersTestJSON-1676313022 tempest-DeleteServersTestJSON-1676313022-project-member] Enqueued Resource ID: ce79170a-31ce-429e-8e08-a911557872f4 with Priority: HIGHEST for action security_group_members [ 795.805596] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce79170a-31ce-429e-8e08-a911557872f4 with Priority: HIGHEST for action security_group_members [ 795.805956] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce79170a-31ce-429e-8e08-a911557872f4 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.807728] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.807728] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.808139] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.808335] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.808510] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.808510] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.811259] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.811259] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.811259] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce79170a-31ce-429e-8e08-a911557872f4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.168262] env[70392]: INFO networking_nsxv3.common.synchronization [req-df614261-7d10-4ab9-8dd2-75eace7127b7 req-65f5aeaf-f5df-45b6-baf8-b949d2a3a65e tempest-TenantUsagesTestJSON-121259612 tempest-TenantUsagesTestJSON-121259612-project-member] Enqueued Resource ID: b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f with Priority: HIGHEST for action security_group_members [ 796.169378] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f with Priority: HIGHEST for action security_group_members [ 796.169913] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.170396] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.170571] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.172833] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.172833] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.172833] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.172833] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.172833] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.172833] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.172833] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.313183] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.314196] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.314912] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.317329] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.346829] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.346829] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.346829] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.346829] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.346829] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.346829] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.346829] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce79170a-31ce-429e-8e08-a911557872f4 is going to be updated. [ 796.375799] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.375799] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.375799] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.376092] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.376092] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.389952] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce79170a-31ce-429e-8e08-a911557872f4 in Status: IN_PROGRESS for 2s [ 796.463069] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-422 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.463291] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-422" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.463412] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-422" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.463799] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-422" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.469053] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.469053] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.469053] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.469053] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.469053] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.469053] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 796.469053] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 796.469053] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 796.469053] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 796.469053] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 796.469053] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 796.469053] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 796.506794] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 796.506794] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.036 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 796.506794] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 796.506794] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-422" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.506794] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-a0c6e304-1d3d-40c2-bd8e-d86b8a393d25 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.506794] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-a0c6e304-1d3d-40c2-bd8e-d86b8a393d25" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.506794] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-a0c6e304-1d3d-40c2-bd8e-d86b8a393d25" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.506794] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-a0c6e304-1d3d-40c2-bd8e-d86b8a393d25" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.506794] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a0c6e304-1d3d-40c2-bd8e-d86b8a393d25',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.675135] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.675306] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.675388] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.675593] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.675690] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.675885] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.675982] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.676074] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.676209] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.676289] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.676375] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f is going to be updated. [ 796.719489] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.719754] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.719754] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.719893] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.720131] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.734285] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f in Status: IN_PROGRESS for 2s [ 796.775595] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44698b7f-7125-46d0-837f-5d44d3ee1aea in Status: SUCCESS [ 796.775861] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44698b7f-7125-46d0-837f-5d44d3ee1aea" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.775999] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44698b7f-7125-46d0-837f-5d44d3ee1aea" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.776244] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44698b7f-7125-46d0-837f-5d44d3ee1aea" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.776442] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.776559] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.776622] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.776780] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.776978] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.777127] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44698b7f-7125-46d0-837f-5d44d3ee1aea" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.777280] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('44698b7f-7125-46d0-837f-5d44d3ee1aea',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.009353] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.011030] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.011030] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.011030] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.011030] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.011030] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port a0c6e304-1d3d-40c2-bd8e-d86b8a393d25 not found, creating... [ 797.011030] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.011457] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.011457] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.011556] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.011681] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.012089] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.012289] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.012463] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.012705] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.012878] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.013050] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: a0c6e304-1d3d-40c2-bd8e-d86b8a393d25 is going to be created. [ 797.046622] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.046954] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.046954] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.047344] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.047719] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.049535] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-a0c6e304-1d3d-40c2-bd8e-d86b8a393d25" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.280500] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('44698b7f-7125-46d0-837f-5d44d3ee1aea',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.782152] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 44698b7f-7125-46d0-837f-5d44d3ee1aea: rpc.has_security_group_logging(os_id): False [ 797.808391] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.808556] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.808605] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.808871] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.809012] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.809250] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.809359] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.809479] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.809696] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.809741] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.809908] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 44698b7f-7125-46d0-837f-5d44d3ee1aea is going to be created. [ 797.887116] env[70392]: INFO networking_nsxv3.common.synchronization [req-fb4ed702-858e-4904-a958-ffb9cb3ada50 req-c76979b7-225a-4432-a9c8-e690e1195768 service nova] Enqueued Resource ID: ce79170a-31ce-429e-8e08-a911557872f4 with Priority: HIGHEST for action security_group_rules [ 797.887419] env[70392]: INFO networking_nsxv3.common.synchronization [req-fb4ed702-858e-4904-a958-ffb9cb3ada50 req-c76979b7-225a-4432-a9c8-e690e1195768 service nova] Enqueued Resource ID: ce79170a-31ce-429e-8e08-a911557872f4 with Priority: HIGHEST for action security_group_members [ 797.887538] env[70392]: INFO networking_nsxv3.common.synchronization [req-fb4ed702-858e-4904-a958-ffb9cb3ada50 req-c76979b7-225a-4432-a9c8-e690e1195768 service nova] Enqueued Resource ID: a0c6e304-1d3d-40c2-bd8e-d86b8a393d25 with Priority: HIGHEST for action port [ 797.890119] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce79170a-31ce-429e-8e08-a911557872f4 with Priority: HIGHEST for action security_group_rules [ 797.890119] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce79170a-31ce-429e-8e08-a911557872f4 with Priority: HIGHEST for action security_group_members [ 797.890119] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0c6e304-1d3d-40c2-bd8e-d86b8a393d25 with Priority: HIGHEST for action port [ 797.890119] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ce79170a-31ce-429e-8e08-a911557872f4 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.890119] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.890419] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.893177] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.893305] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ce79170a-31ce-429e-8e08-a911557872f4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.894467] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce79170a-31ce-429e-8e08-a911557872f4 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.894606] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.894928] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-a0c6e304-1d3d-40c2-bd8e-d86b8a393d25 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.895848] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a0c6e304-1d3d-40c2-bd8e-d86b8a393d25" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.895964] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a0c6e304-1d3d-40c2-bd8e-d86b8a393d25" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.897863] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a0c6e304-1d3d-40c2-bd8e-d86b8a393d25" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.897863] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a0c6e304-1d3d-40c2-bd8e-d86b8a393d25',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.909677] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.909677] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.909677] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.909677] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.909677] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.924523] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 44698b7f-7125-46d0-837f-5d44d3ee1aea in Status: IN_PROGRESS for 2s [ 798.010710] env[70392]: INFO networking_nsxv3.common.synchronization [req-e79c61bb-c416-46a8-8a7a-dba5c1bf10db req-3f2a5c59-6b86-4b2a-9733-240df53379a5 tempest-FloatingIPsAssociationTestJSON-516556258 tempest-FloatingIPsAssociationTestJSON-516556258-project-member] Enqueued Resource ID: 87729ccf-b5c1-4c71-b616-13269541067e with Priority: HIGHEST for action security_group_members [ 798.015412] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87729ccf-b5c1-4c71-b616-13269541067e with Priority: HIGHEST for action security_group_members [ 798.016412] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-87729ccf-b5c1-4c71-b616-13269541067e taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.017028] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87729ccf-b5c1-4c71-b616-13269541067e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.017028] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87729ccf-b5c1-4c71-b616-13269541067e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.017028] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87729ccf-b5c1-4c71-b616-13269541067e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.017231] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.017397] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.020024] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.021333] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.021333] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.021333] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('87729ccf-b5c1-4c71-b616-13269541067e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.405233] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce79170a-31ce-429e-8e08-a911557872f4 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.405233] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.405233] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a0c6e304-1d3d-40c2-bd8e-d86b8a393d25 with status ACTIVE [ 798.405233] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.405233] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.405233] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.405233] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.405233] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.405233] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.411625] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.411625] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.411625] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.411625] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.414464] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.414464] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.414464] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.414464] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.414464] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.414464] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a0c6e304-1d3d-40c2-bd8e-d86b8a393d25 is going to be updated. [ 798.415635] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce79170a-31ce-429e-8e08-a911557872f4 in Status: SUCCESS [ 798.415954] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce79170a-31ce-429e-8e08-a911557872f4 deletion is rescheduled due to dependency. [ 798.416195] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.416955] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.417275] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.417609] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.418022] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.418197] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.418555] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.418730] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.418969] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce79170a-31ce-429e-8e08-a911557872f4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.442474] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.442652] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.442728] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.443212] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.443485] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.444025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a0c6e304-1d3d-40c2-bd8e-d86b8a393d25" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.525924] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('87729ccf-b5c1-4c71-b616-13269541067e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.745560] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f in Status: SUCCESS [ 798.745768] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f deletion is rescheduled due to dependency. [ 798.745853] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.923142] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ce79170a-31ce-429e-8e08-a911557872f4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.967785] env[70392]: INFO networking_nsxv3.common.synchronization [req-59fc4642-ec0e-47d5-8bf5-c63670e88edb req-29ad5d5b-b4b2-46cd-8ca8-a80b24be1fb9 tempest-ServerDiskConfigTestJSON-277542510 tempest-ServerDiskConfigTestJSON-277542510-project-member] Enqueued Resource ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 with Priority: HIGHEST for action security_group_members [ 798.968854] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 with Priority: HIGHEST for action security_group_members [ 798.970408] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60d7eaa-9583-4c75-97fa-4049c63576b6 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.970880] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.970979] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.971217] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.971383] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.971494] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.971720] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.972015] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.972213] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.972356] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b60d7eaa-9583-4c75-97fa-4049c63576b6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.028796] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('87729ccf-b5c1-4c71-b616-13269541067e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.424416] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ce79170a-31ce-429e-8e08-a911557872f4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.476090] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.476090] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.476090] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.476090] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.476090] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.476090] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.476090] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.476090] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.476090] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.476090] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.476090] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 is going to be updated. [ 799.479705] env[70392]: INFO networking_nsxv3.common.synchronization [None req-037be2bc-c251-4da5-9761-543f3b020968 None None] Enqueued Resource ID: 17cf2b8e-f978-4fc1-9f0a-2086699930cc with Priority: HIGHEST for action port [ 799.480055] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17cf2b8e-f978-4fc1-9f0a-2086699930cc with Priority: HIGHEST for action port [ 799.481155] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-17cf2b8e-f978-4fc1-9f0a-2086699930cc taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.481554] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-17cf2b8e-f978-4fc1-9f0a-2086699930cc" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.481554] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-17cf2b8e-f978-4fc1-9f0a-2086699930cc" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.481942] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-17cf2b8e-f978-4fc1-9f0a-2086699930cc" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.481942] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('17cf2b8e-f978-4fc1-9f0a-2086699930cc',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.505259] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.505402] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.505473] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.505680] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.505820] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.516925] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 in Status: IN_PROGRESS for 2s [ 799.531240] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.532583] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.532726] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.532952] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.533057] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.533165] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 87729ccf-b5c1-4c71-b616-13269541067e is going to be updated. [ 799.563639] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.563818] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.563893] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.564202] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.564416] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.578604] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87729ccf-b5c1-4c71-b616-13269541067e in Status: IN_PROGRESS for 2s [ 799.927058] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.927058] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.927058] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.927242] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.927329] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.927443] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce79170a-31ce-429e-8e08-a911557872f4 is going to be updated. [ 799.975947] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 44698b7f-7125-46d0-837f-5d44d3ee1aea in Status: SUCCESS [ 799.975947] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-44698b7f-7125-46d0-837f-5d44d3ee1aea" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.987767] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 17cf2b8e-f978-4fc1-9f0a-2086699930cc [ 799.987767] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.987767] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.987767] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.987767] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.987767] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.987767] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:17cf2b8e-f978-4fc1-9f0a-2086699930cc already deleted. [ 799.987767] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-17cf2b8e-f978-4fc1-9f0a-2086699930cc" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.002974] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.002974] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.003120] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.003384] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.003598] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.017981] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce79170a-31ce-429e-8e08-a911557872f4 in Status: IN_PROGRESS for 2s [ 801.008306] env[70392]: INFO networking_nsxv3.common.synchronization [req-42c92f04-5450-4356-a245-990ea73e0bee req-be8df52e-35a7-4ad3-be81-c8d59932fa33 tempest-ServersTestJSON-998170705 tempest-ServersTestJSON-998170705-project-member] Enqueued Resource ID: e91c56eb-c593-402a-8bcc-78c2b86ccae6 with Priority: HIGHEST for action security_group_members [ 801.008306] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e91c56eb-c593-402a-8bcc-78c2b86ccae6 with Priority: HIGHEST for action security_group_members [ 801.008306] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-e91c56eb-c593-402a-8bcc-78c2b86ccae6 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.008306] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e91c56eb-c593-402a-8bcc-78c2b86ccae6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.008306] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e91c56eb-c593-402a-8bcc-78c2b86ccae6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.008850] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e91c56eb-c593-402a-8bcc-78c2b86ccae6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.008850] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.008850] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.008850] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.008850] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.009151] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.009151] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e91c56eb-c593-402a-8bcc-78c2b86ccae6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.500962] env[70392]: INFO networking_nsxv3.common.synchronization [req-b9a01e0e-afe9-4217-af91-8996b435173b req-235f9d7f-a320-42e2-9b3d-c10113180a9f tempest-ServersAdminNegativeTestJSON-1845401423 tempest-ServersAdminNegativeTestJSON-1845401423-project-member] Enqueued Resource ID: 59adf132-72f4-4d43-847e-1af9bc3c6073 with Priority: HIGHEST for action security_group_members [ 801.502124] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59adf132-72f4-4d43-847e-1af9bc3c6073 with Priority: HIGHEST for action security_group_members [ 801.502124] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-59adf132-72f4-4d43-847e-1af9bc3c6073 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.502124] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59adf132-72f4-4d43-847e-1af9bc3c6073" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.502124] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59adf132-72f4-4d43-847e-1af9bc3c6073" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.502124] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59adf132-72f4-4d43-847e-1af9bc3c6073" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.502389] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.502389] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.502467] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.502923] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.502923] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.502923] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('59adf132-72f4-4d43-847e-1af9bc3c6073',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.515674] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.515674] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.515674] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.515674] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.515674] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.515674] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.515674] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.515674] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.515674] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.515674] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.515674] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e91c56eb-c593-402a-8bcc-78c2b86ccae6 already deleted. [ 801.515674] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e91c56eb-c593-402a-8bcc-78c2b86ccae6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.529427] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 in Status: SUCCESS [ 801.529547] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 deletion is rescheduled due to dependency. [ 801.529673] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.532956] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-654 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.533267] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-654" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.533350] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-654" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.533606] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-654" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.533869] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.535547] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.535767] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.536048] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.536235] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.536459] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 801.536577] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 801.536688] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 801.536816] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 801.536928] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 801.537200] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 801.537350] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 801.559504] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 801.559876] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 801.560085] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 801.560334] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-654" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.560729] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-a635c2a9-1577-4b0c-aaee-fdd8aea33f94 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.560971] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-a635c2a9-1577-4b0c-aaee-fdd8aea33f94" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.561140] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-a635c2a9-1577-4b0c-aaee-fdd8aea33f94" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.561493] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-a635c2a9-1577-4b0c-aaee-fdd8aea33f94" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.561712] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a635c2a9-1577-4b0c-aaee-fdd8aea33f94',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.589421] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87729ccf-b5c1-4c71-b616-13269541067e in Status: SUCCESS [ 801.590533] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87729ccf-b5c1-4c71-b616-13269541067e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.005798] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.006013] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.006091] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.006310] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.032572] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce79170a-31ce-429e-8e08-a911557872f4 in Status: SUCCESS [ 802.033925] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.034195] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.034469] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.034676] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.034828] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.034895] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.035083] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.035166] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.035654] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.035654] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ce79170a-31ce-429e-8e08-a911557872f4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.044314] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.044314] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.044314] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.044314] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.044314] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.044314] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.044314] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59adf132-72f4-4d43-847e-1af9bc3c6073 is going to be updated. [ 802.064569] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.064853] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.065049] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.065422] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.065595] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.065767] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port a635c2a9-1577-4b0c-aaee-fdd8aea33f94 not found, creating... [ 802.066081] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.066264] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.066391] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.066750] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.066962] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.068452] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.069493] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.069681] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.070016] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.070407] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.070758] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: a635c2a9-1577-4b0c-aaee-fdd8aea33f94 is going to be created. [ 802.079687] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.079945] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.079945] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.080207] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.080368] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.090305] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59adf132-72f4-4d43-847e-1af9bc3c6073 in Status: IN_PROGRESS for 2s [ 802.102944] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.102944] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.102944] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.102944] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.102944] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.102944] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-a635c2a9-1577-4b0c-aaee-fdd8aea33f94" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.419821] env[70392]: INFO networking_nsxv3.common.synchronization [None req-73f1a529-352d-40c6-b611-a9bcba9840f5 None None] Enqueued Resource ID: 48bb2137-1307-4a83-a1e0-3218ec411d8e with Priority: HIGHEST for action port [ 802.420469] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48bb2137-1307-4a83-a1e0-3218ec411d8e with Priority: HIGHEST for action port [ 802.423671] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-48bb2137-1307-4a83-a1e0-3218ec411d8e taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.423671] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48bb2137-1307-4a83-a1e0-3218ec411d8e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.423671] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48bb2137-1307-4a83-a1e0-3218ec411d8e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.423671] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48bb2137-1307-4a83-a1e0-3218ec411d8e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.423671] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48bb2137-1307-4a83-a1e0-3218ec411d8e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.541505] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce79170a-31ce-429e-8e08-a911557872f4 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.541713] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.541753] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.541973] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.542338] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.542338] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.542475] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.542524] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.542620] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.542709] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.542857] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce79170a-31ce-429e-8e08-a911557872f4 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.542971] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.543011] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.543171] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.543317] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.543403] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.543467] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.543605] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.543683] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.543776] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.543856] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ce79170a-31ce-429e-8e08-a911557872f4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.866023] env[70392]: INFO networking_nsxv3.common.synchronization [req-7b4d4712-e7af-454d-9ad1-9f7666f1578e req-80d1267d-d96b-4673-85da-bcd0abf83487 tempest-ServerPasswordTestJSON-1253827618 tempest-ServerPasswordTestJSON-1253827618-project-member] Enqueued Resource ID: 0ff592de-806a-4492-9791-c0de60e8c15a with Priority: HIGHEST for action security_group_members [ 802.866696] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ff592de-806a-4492-9791-c0de60e8c15a with Priority: HIGHEST for action security_group_members [ 802.867150] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ff592de-806a-4492-9791-c0de60e8c15a taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.869696] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ff592de-806a-4492-9791-c0de60e8c15a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.869696] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ff592de-806a-4492-9791-c0de60e8c15a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.869696] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ff592de-806a-4492-9791-c0de60e8c15a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.869696] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.869696] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.869696] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.869696] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.869696] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.869696] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ff592de-806a-4492-9791-c0de60e8c15a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.926678] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 48bb2137-1307-4a83-a1e0-3218ec411d8e [ 802.926912] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.927059] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.927146] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.927365] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.927457] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.927550] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:48bb2137-1307-4a83-a1e0-3218ec411d8e already deleted. [ 802.927628] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48bb2137-1307-4a83-a1e0-3218ec411d8e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.047446] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ce79170a-31ce-429e-8e08-a911557872f4: rpc.has_security_group_logging(os_id): False [ 803.066148] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.066351] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.066398] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.066691] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.066883] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.067185] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.067445] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.067522] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.067734] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.067780] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.067959] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.068067] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.068129] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.068272] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.068367] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.068518] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.068608] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.068673] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.069295] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.069295] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.069295] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ce79170a-31ce-429e-8e08-a911557872f4 is going to be updated. [ 803.079546] env[70392]: INFO networking_nsxv3.common.synchronization [req-42c92f04-5450-4356-a245-990ea73e0bee req-8f743c49-8938-41e0-83d6-ae443a0966b5 service nova] Enqueued Resource ID: e91c56eb-c593-402a-8bcc-78c2b86ccae6 with Priority: HIGHEST for action security_group_rules [ 803.079722] env[70392]: INFO networking_nsxv3.common.synchronization [req-42c92f04-5450-4356-a245-990ea73e0bee req-8f743c49-8938-41e0-83d6-ae443a0966b5 service nova] Enqueued Resource ID: e91c56eb-c593-402a-8bcc-78c2b86ccae6 with Priority: HIGHEST for action security_group_members [ 803.079856] env[70392]: INFO networking_nsxv3.common.synchronization [req-42c92f04-5450-4356-a245-990ea73e0bee req-8f743c49-8938-41e0-83d6-ae443a0966b5 service nova] Enqueued Resource ID: a635c2a9-1577-4b0c-aaee-fdd8aea33f94 with Priority: HIGHEST for action port [ 803.084292] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e91c56eb-c593-402a-8bcc-78c2b86ccae6 with Priority: HIGHEST for action security_group_rules [ 803.084292] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e91c56eb-c593-402a-8bcc-78c2b86ccae6 with Priority: HIGHEST for action security_group_members [ 803.084292] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a635c2a9-1577-4b0c-aaee-fdd8aea33f94 with Priority: HIGHEST for action port [ 803.084292] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e91c56eb-c593-402a-8bcc-78c2b86ccae6 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.084292] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e91c56eb-c593-402a-8bcc-78c2b86ccae6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.084292] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e91c56eb-c593-402a-8bcc-78c2b86ccae6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.084292] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e91c56eb-c593-402a-8bcc-78c2b86ccae6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.084292] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e91c56eb-c593-402a-8bcc-78c2b86ccae6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.084292] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-e91c56eb-c593-402a-8bcc-78c2b86ccae6 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.084292] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e91c56eb-c593-402a-8bcc-78c2b86ccae6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.084292] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e91c56eb-c593-402a-8bcc-78c2b86ccae6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.084292] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e91c56eb-c593-402a-8bcc-78c2b86ccae6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.084292] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.084292] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.084292] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.084292] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.084292] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.084292] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e91c56eb-c593-402a-8bcc-78c2b86ccae6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.084292] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-a635c2a9-1577-4b0c-aaee-fdd8aea33f94 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.084948] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a635c2a9-1577-4b0c-aaee-fdd8aea33f94" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.084948] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a635c2a9-1577-4b0c-aaee-fdd8aea33f94" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.084948] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a635c2a9-1577-4b0c-aaee-fdd8aea33f94" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.084948] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a635c2a9-1577-4b0c-aaee-fdd8aea33f94',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.271008] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.271224] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.271224] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.271726] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.272018] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.292047] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ce79170a-31ce-429e-8e08-a911557872f4 in Status: IN_PROGRESS for 2s [ 803.376071] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.376783] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.376783] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.376783] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.376783] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.377047] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.377047] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.377402] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.377402] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.377402] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.377555] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ff592de-806a-4492-9791-c0de60e8c15a is going to be updated. [ 803.440323] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.440323] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.440446] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.440685] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.440833] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.454260] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ff592de-806a-4492-9791-c0de60e8c15a in Status: IN_PROGRESS for 2s [ 803.586303] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-e91c56eb-c593-402a-8bcc-78c2b86ccae6 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.586468] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e91c56eb-c593-402a-8bcc-78c2b86ccae6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.586604] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a635c2a9-1577-4b0c-aaee-fdd8aea33f94 with status ACTIVE [ 803.586776] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.586885] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.586969] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.587415] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.587415] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.587782] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.587782] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.587782] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.587986] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.587986] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.588152] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.588250] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.588284] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.588457] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.588457] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.588598] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a635c2a9-1577-4b0c-aaee-fdd8aea33f94 is going to be updated. [ 803.589731] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e91c56eb-c593-402a-8bcc-78c2b86ccae6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.614105] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.614256] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.614432] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.614529] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.614813] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.614813] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a635c2a9-1577-4b0c-aaee-fdd8aea33f94" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.707331] env[70392]: INFO networking_nsxv3.common.synchronization [None req-d53eedd0-6d2e-436d-a558-1de682232d57 tempest-ImagesOneServerNegativeTestJSON-1691594958 tempest-ImagesOneServerNegativeTestJSON-1691594958-project-member] Enqueued Resource ID: b89f873b-7725-4d5a-8800-9acd21c3fda5 with Priority: HIGHEST for action security_group_rules [ 803.707412] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b89f873b-7725-4d5a-8800-9acd21c3fda5 with Priority: HIGHEST for action security_group_rules [ 803.707728] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b89f873b-7725-4d5a-8800-9acd21c3fda5 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.707856] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b89f873b-7725-4d5a-8800-9acd21c3fda5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.707927] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b89f873b-7725-4d5a-8800-9acd21c3fda5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.708240] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b89f873b-7725-4d5a-8800-9acd21c3fda5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.708348] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b89f873b-7725-4d5a-8800-9acd21c3fda5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.815685] env[70392]: INFO networking_nsxv3.common.synchronization [None req-580bab1f-f6cd-4537-88f3-2e54ecb335fd tempest-ImagesOneServerNegativeTestJSON-1691594958 tempest-ImagesOneServerNegativeTestJSON-1691594958-project-member] Enqueued Resource ID: b89f873b-7725-4d5a-8800-9acd21c3fda5 with Priority: HIGHEST for action security_group_rules [ 803.816421] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b89f873b-7725-4d5a-8800-9acd21c3fda5 with Priority: HIGHEST for action security_group_rules [ 803.816840] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b89f873b-7725-4d5a-8800-9acd21c3fda5 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.816961] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b89f873b-7725-4d5a-8800-9acd21c3fda5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.093415] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e91c56eb-c593-402a-8bcc-78c2b86ccae6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.106722] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59adf132-72f4-4d43-847e-1af9bc3c6073 in Status: IN_PROGRESS for 4s [ 804.244565] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.244797] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.244797] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.244912] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.245021] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.245132] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b89f873b-7725-4d5a-8800-9acd21c3fda5 already deleted. [ 804.245222] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b89f873b-7725-4d5a-8800-9acd21c3fda5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.245815] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b89f873b-7725-4d5a-8800-9acd21c3fda5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.246017] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b89f873b-7725-4d5a-8800-9acd21c3fda5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.246139] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b89f873b-7725-4d5a-8800-9acd21c3fda5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.598726] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.598726] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.598726] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.598726] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.598726] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.598726] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e91c56eb-c593-402a-8bcc-78c2b86ccae6 is going to be created. [ 804.624805] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.624805] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.624805] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.624805] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.624805] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.637018] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e91c56eb-c593-402a-8bcc-78c2b86ccae6 in Status: UNINITIALIZED for 2s [ 804.783394] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.783394] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.783394] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.783394] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.783394] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.783394] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b89f873b-7725-4d5a-8800-9acd21c3fda5 already deleted. [ 804.783394] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b89f873b-7725-4d5a-8800-9acd21c3fda5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.306991] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ce79170a-31ce-429e-8e08-a911557872f4 in Status: SUCCESS [ 805.307346] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.467309] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ff592de-806a-4492-9791-c0de60e8c15a in Status: SUCCESS [ 805.467309] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ff592de-806a-4492-9791-c0de60e8c15a deletion is rescheduled due to dependency. [ 805.467309] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ff592de-806a-4492-9791-c0de60e8c15a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.119175] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59adf132-72f4-4d43-847e-1af9bc3c6073 in Status: SUCCESS [ 806.119265] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59adf132-72f4-4d43-847e-1af9bc3c6073 deletion is rescheduled due to dependency. [ 806.119400] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59adf132-72f4-4d43-847e-1af9bc3c6073" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.627157] env[70392]: INFO networking_nsxv3.common.synchronization [req-3c76c529-6418-4c62-bc8a-6f4941900021 req-091da583-66de-4ab7-9c0b-d5f9ba973700 tempest-ServerGroupTestJSON-485529314 tempest-ServerGroupTestJSON-485529314-project-member] Enqueued Resource ID: 839b66b0-e5ba-4f94-b08b-508956410270 with Priority: HIGHEST for action security_group_members [ 806.627683] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 839b66b0-e5ba-4f94-b08b-508956410270 with Priority: HIGHEST for action security_group_members [ 806.627982] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-839b66b0-e5ba-4f94-b08b-508956410270 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.628130] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-839b66b0-e5ba-4f94-b08b-508956410270" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.628192] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-839b66b0-e5ba-4f94-b08b-508956410270" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.628446] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-839b66b0-e5ba-4f94-b08b-508956410270" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.628606] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.628706] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.628803] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.628914] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.629009] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.629113] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('839b66b0-e5ba-4f94-b08b-508956410270',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.646907] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e91c56eb-c593-402a-8bcc-78c2b86ccae6 in Status: SUCCESS [ 806.647147] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e91c56eb-c593-402a-8bcc-78c2b86ccae6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.647319] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e91c56eb-c593-402a-8bcc-78c2b86ccae6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.647526] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e91c56eb-c593-402a-8bcc-78c2b86ccae6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.647711] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.647825] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.647890] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.648053] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.648138] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.648222] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e91c56eb-c593-402a-8bcc-78c2b86ccae6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.648315] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e91c56eb-c593-402a-8bcc-78c2b86ccae6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.945091] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-69 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.945415] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-69" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.945954] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-69" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.946438] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-69" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.946801] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.947046] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.947273] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.947634] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.947908] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.948322] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 806.948545] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 806.948720] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 806.948848] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 806.948970] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 806.949139] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 806.949381] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 806.973037] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 806.973178] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 806.973254] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 806.973442] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-69" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.973770] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-17b41393-c34e-4282-801a-5156651d15e7 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.973961] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-17b41393-c34e-4282-801a-5156651d15e7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.974110] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-17b41393-c34e-4282-801a-5156651d15e7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.974435] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-17b41393-c34e-4282-801a-5156651d15e7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.974579] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('17b41393-c34e-4282-801a-5156651d15e7',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.131181] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.131424] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.131512] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.131728] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.131824] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.132039] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.132141] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.132204] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.132355] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.132429] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.132513] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 839b66b0-e5ba-4f94-b08b-508956410270 already deleted. [ 807.132593] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-839b66b0-e5ba-4f94-b08b-508956410270" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.150997] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e91c56eb-c593-402a-8bcc-78c2b86ccae6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.478041] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.478369] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.480436] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.480540] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.480713] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.480899] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 17b41393-c34e-4282-801a-5156651d15e7 not found, creating... [ 807.481203] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.481375] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.481552] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.481810] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.481956] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.484865] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.485103] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.485265] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.485539] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.485722] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.485902] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 17b41393-c34e-4282-801a-5156651d15e7 is going to be created. [ 807.512024] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.512024] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.512024] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.512024] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.512024] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.512024] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-17b41393-c34e-4282-801a-5156651d15e7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.654304] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e91c56eb-c593-402a-8bcc-78c2b86ccae6: rpc.has_security_group_logging(os_id): False [ 807.699485] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.699618] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.699693] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.699942] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.700060] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.700337] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.700441] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.700505] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.700671] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.700810] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.700854] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e91c56eb-c593-402a-8bcc-78c2b86ccae6 is going to be created. [ 807.779859] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.780070] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.780162] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.780390] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.780590] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.798198] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e91c56eb-c593-402a-8bcc-78c2b86ccae6 in Status: IN_PROGRESS for 2s [ 808.377979] env[70392]: INFO networking_nsxv3.common.synchronization [req-3c76c529-6418-4c62-bc8a-6f4941900021 req-9472839d-18e2-420b-94cd-fc572487fe72 service nova] Enqueued Resource ID: 839b66b0-e5ba-4f94-b08b-508956410270 with Priority: HIGHEST for action security_group_rules [ 808.378179] env[70392]: INFO networking_nsxv3.common.synchronization [req-3c76c529-6418-4c62-bc8a-6f4941900021 req-9472839d-18e2-420b-94cd-fc572487fe72 service nova] Enqueued Resource ID: 839b66b0-e5ba-4f94-b08b-508956410270 with Priority: HIGHEST for action security_group_members [ 808.378319] env[70392]: INFO networking_nsxv3.common.synchronization [req-3c76c529-6418-4c62-bc8a-6f4941900021 req-9472839d-18e2-420b-94cd-fc572487fe72 service nova] Enqueued Resource ID: 17b41393-c34e-4282-801a-5156651d15e7 with Priority: HIGHEST for action port [ 808.378560] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 839b66b0-e5ba-4f94-b08b-508956410270 with Priority: HIGHEST for action security_group_rules [ 808.378689] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 839b66b0-e5ba-4f94-b08b-508956410270 with Priority: HIGHEST for action security_group_members [ 808.378786] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17b41393-c34e-4282-801a-5156651d15e7 with Priority: HIGHEST for action port [ 808.379824] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-839b66b0-e5ba-4f94-b08b-508956410270 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.379947] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-839b66b0-e5ba-4f94-b08b-508956410270" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.383685] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-839b66b0-e5ba-4f94-b08b-508956410270" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.384754] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-839b66b0-e5ba-4f94-b08b-508956410270" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.384858] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('839b66b0-e5ba-4f94-b08b-508956410270',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.386949] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-839b66b0-e5ba-4f94-b08b-508956410270 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.387119] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-839b66b0-e5ba-4f94-b08b-508956410270" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.387197] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-839b66b0-e5ba-4f94-b08b-508956410270" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.387378] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-839b66b0-e5ba-4f94-b08b-508956410270" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.387550] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.387668] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.387736] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.387887] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.388018] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.388085] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('839b66b0-e5ba-4f94-b08b-508956410270',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.389691] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-17b41393-c34e-4282-801a-5156651d15e7 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.389691] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-17b41393-c34e-4282-801a-5156651d15e7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.389691] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-17b41393-c34e-4282-801a-5156651d15e7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.389691] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-17b41393-c34e-4282-801a-5156651d15e7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.389691] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('17b41393-c34e-4282-801a-5156651d15e7',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.887710] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-839b66b0-e5ba-4f94-b08b-508956410270 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.888011] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-839b66b0-e5ba-4f94-b08b-508956410270" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.892889] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 17b41393-c34e-4282-801a-5156651d15e7 with status ACTIVE [ 808.892889] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.892889] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.892889] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.893112] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.893142] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.893317] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.893430] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.893500] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.893662] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.893744] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.893932] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.894034] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.894097] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.894231] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.894306] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.894390] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 17b41393-c34e-4282-801a-5156651d15e7 is going to be updated. [ 808.895512] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('839b66b0-e5ba-4f94-b08b-508956410270',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.918351] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.919084] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.919084] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.919084] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.919084] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.919084] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-17b41393-c34e-4282-801a-5156651d15e7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.400274] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('839b66b0-e5ba-4f94-b08b-508956410270',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.651480] env[70392]: INFO networking_nsxv3.common.synchronization [None req-2ccb8be7-92c2-4b47-9b21-b85b3591fd51 tempest-MigrationsAdminTest-1525374997 tempest-MigrationsAdminTest-1525374997-project-member] Enqueued Resource ID: eaf13217-6b71-4efa-a293-f5a8c9a0eba6 with Priority: HIGHEST for action security_group_rules [ 809.652046] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eaf13217-6b71-4efa-a293-f5a8c9a0eba6 with Priority: HIGHEST for action security_group_rules [ 809.652343] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eaf13217-6b71-4efa-a293-f5a8c9a0eba6 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.652472] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eaf13217-6b71-4efa-a293-f5a8c9a0eba6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.652542] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eaf13217-6b71-4efa-a293-f5a8c9a0eba6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.652818] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eaf13217-6b71-4efa-a293-f5a8c9a0eba6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.652905] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eaf13217-6b71-4efa-a293-f5a8c9a0eba6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.745941] env[70392]: INFO networking_nsxv3.common.synchronization [None req-6f72cbde-7abb-415b-b2a5-64ed1c999668 tempest-MigrationsAdminTest-1525374997 tempest-MigrationsAdminTest-1525374997-project-member] Enqueued Resource ID: eaf13217-6b71-4efa-a293-f5a8c9a0eba6 with Priority: HIGHEST for action security_group_rules [ 809.746837] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eaf13217-6b71-4efa-a293-f5a8c9a0eba6 with Priority: HIGHEST for action security_group_rules [ 809.747434] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eaf13217-6b71-4efa-a293-f5a8c9a0eba6 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.747852] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eaf13217-6b71-4efa-a293-f5a8c9a0eba6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.827026] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e91c56eb-c593-402a-8bcc-78c2b86ccae6 in Status: SUCCESS [ 809.827187] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e91c56eb-c593-402a-8bcc-78c2b86ccae6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.902598] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.903028] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.903028] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.903249] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.903364] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.903474] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 839b66b0-e5ba-4f94-b08b-508956410270 is going to be created. [ 809.936714] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.936714] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.936847] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.937036] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.937216] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.962760] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 839b66b0-e5ba-4f94-b08b-508956410270 in Status: UNINITIALIZED for 2s [ 810.180258] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.180492] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.180595] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.180855] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.180979] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.181146] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eaf13217-6b71-4efa-a293-f5a8c9a0eba6 already deleted. [ 810.181232] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eaf13217-6b71-4efa-a293-f5a8c9a0eba6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.181419] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eaf13217-6b71-4efa-a293-f5a8c9a0eba6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.181664] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eaf13217-6b71-4efa-a293-f5a8c9a0eba6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.181736] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eaf13217-6b71-4efa-a293-f5a8c9a0eba6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.707263] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.707432] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.707544] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.707705] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.707795] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.707886] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eaf13217-6b71-4efa-a293-f5a8c9a0eba6 already deleted. [ 810.707970] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eaf13217-6b71-4efa-a293-f5a8c9a0eba6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.974423] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 839b66b0-e5ba-4f94-b08b-508956410270 in Status: SUCCESS [ 811.974732] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-839b66b0-e5ba-4f94-b08b-508956410270" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.974817] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-839b66b0-e5ba-4f94-b08b-508956410270" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.975088] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-839b66b0-e5ba-4f94-b08b-508956410270" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.975239] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.975353] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.975418] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.975572] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.975650] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.975955] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-839b66b0-e5ba-4f94-b08b-508956410270" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.975955] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('839b66b0-e5ba-4f94-b08b-508956410270',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.478559] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-839b66b0-e5ba-4f94-b08b-508956410270 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.478772] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-839b66b0-e5ba-4f94-b08b-508956410270" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.478829] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-839b66b0-e5ba-4f94-b08b-508956410270" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.479070] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-839b66b0-e5ba-4f94-b08b-508956410270" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.479270] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.479418] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.479497] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.479684] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.479777] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.479864] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-839b66b0-e5ba-4f94-b08b-508956410270" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.480041] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-839b66b0-e5ba-4f94-b08b-508956410270 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.480136] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-839b66b0-e5ba-4f94-b08b-508956410270" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.480199] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-839b66b0-e5ba-4f94-b08b-508956410270" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.480347] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-839b66b0-e5ba-4f94-b08b-508956410270" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.480531] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.480626] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.480685] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.480826] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.480907] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.480988] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-839b66b0-e5ba-4f94-b08b-508956410270" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.481094] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('839b66b0-e5ba-4f94-b08b-508956410270',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.984031] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 839b66b0-e5ba-4f94-b08b-508956410270: rpc.has_security_group_logging(os_id): False [ 813.004044] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.004519] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.004638] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.005451] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.005451] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.005451] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.005451] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.005451] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.005451] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.005718] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.005718] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.005984] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.005984] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.005984] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.006152] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.006243] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.006727] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.006727] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.006727] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.006727] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.006727] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 839b66b0-e5ba-4f94-b08b-508956410270 is going to be created. [ 813.087798] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.087798] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.087798] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.087798] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.087798] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.108315] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 839b66b0-e5ba-4f94-b08b-508956410270 in Status: IN_PROGRESS for 2s [ 814.748390] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 814.748743] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 815.126760] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 839b66b0-e5ba-4f94-b08b-508956410270 in Status: SUCCESS [ 815.127120] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-839b66b0-e5ba-4f94-b08b-508956410270" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.153317] env[70392]: INFO networking_nsxv3.common.synchronization [req-74f1b6fb-7b12-4a29-a868-a9c5f44d252c req-a499f85c-cece-46e6-816a-ad78139135d5 tempest-ServersAdminTestJSON-721710769 tempest-ServersAdminTestJSON-721710769-project-member] Enqueued Resource ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 with Priority: HIGHEST for action security_group_members [ 816.153317] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 with Priority: HIGHEST for action security_group_members [ 816.153317] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-f54639a3-c11e-4833-b47a-e0b477c46dd5 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.153317] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.153317] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.153317] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.153317] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.154191] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.154191] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.154191] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.154191] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.154308] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f54639a3-c11e-4833-b47a-e0b477c46dd5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.657594] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.657904] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.657989] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.658235] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.658330] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.658536] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.658639] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.658702] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.658851] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.658934] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.659062] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 already deleted. [ 816.659155] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.672295] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-880 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.672502] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-880" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.672605] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-880" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.672929] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-880" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.673212] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.673371] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.673491] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.673706] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.674250] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.674469] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 816.674627] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 816.674768] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 816.674977] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 816.675127] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 816.675238] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 816.675372] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 816.696302] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 816.696723] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 816.696723] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 816.696855] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-880" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.697110] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-fa0f5e4e-90f9-4185-b78b-79c396679750 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.697290] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-fa0f5e4e-90f9-4185-b78b-79c396679750" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.697404] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-fa0f5e4e-90f9-4185-b78b-79c396679750" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.697742] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-fa0f5e4e-90f9-4185-b78b-79c396679750" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.697883] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa0f5e4e-90f9-4185-b78b-79c396679750',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.029498] env[70392]: INFO networking_nsxv3.common.synchronization [req-35a33c91-bbe5-483f-9f08-27eeca93220e req-fcada422-0287-4e6d-8895-c8badb72b51a tempest-ServersTestFqdnHostnames-1925581123 tempest-ServersTestFqdnHostnames-1925581123-project-member] Enqueued Resource ID: cca6e4dd-68c9-4fd2-8e1a-cda645da02e4 with Priority: HIGHEST for action security_group_members [ 817.030106] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cca6e4dd-68c9-4fd2-8e1a-cda645da02e4 with Priority: HIGHEST for action security_group_members [ 817.030531] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-cca6e4dd-68c9-4fd2-8e1a-cda645da02e4 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.030675] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cca6e4dd-68c9-4fd2-8e1a-cda645da02e4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.030744] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cca6e4dd-68c9-4fd2-8e1a-cda645da02e4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.030947] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cca6e4dd-68c9-4fd2-8e1a-cda645da02e4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.031313] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.031425] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.031703] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.032025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.032122] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.032324] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cca6e4dd-68c9-4fd2-8e1a-cda645da02e4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.204340] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.204340] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.204340] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.204340] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.204340] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.204340] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port fa0f5e4e-90f9-4185-b78b-79c396679750 not found, creating... [ 817.204340] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.204340] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.204340] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.204340] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.204340] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.204968] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.204968] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.206040] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.206356] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.206588] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.206817] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: fa0f5e4e-90f9-4185-b78b-79c396679750 is going to be created. [ 817.232268] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.232268] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.232268] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.232268] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.232268] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.232268] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-fa0f5e4e-90f9-4185-b78b-79c396679750" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.534475] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.538178] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.538804] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.538804] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.562455] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.562654] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.562756] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.562831] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.563048] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.563110] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.563211] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cca6e4dd-68c9-4fd2-8e1a-cda645da02e4 is going to be updated. [ 817.608079] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.608079] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.608079] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.608079] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.608079] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.651939] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cca6e4dd-68c9-4fd2-8e1a-cda645da02e4 in Status: IN_PROGRESS for 2s [ 818.007308] env[70392]: INFO networking_nsxv3.common.synchronization [req-74f1b6fb-7b12-4a29-a868-a9c5f44d252c req-0083d688-a80c-40bc-9a19-8592aaa54be0 service nova] Enqueued Resource ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 with Priority: HIGHEST for action security_group_rules [ 818.007529] env[70392]: INFO networking_nsxv3.common.synchronization [req-74f1b6fb-7b12-4a29-a868-a9c5f44d252c req-0083d688-a80c-40bc-9a19-8592aaa54be0 service nova] Enqueued Resource ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 with Priority: HIGHEST for action security_group_members [ 818.007662] env[70392]: INFO networking_nsxv3.common.synchronization [req-74f1b6fb-7b12-4a29-a868-a9c5f44d252c req-0083d688-a80c-40bc-9a19-8592aaa54be0 service nova] Enqueued Resource ID: fa0f5e4e-90f9-4185-b78b-79c396679750 with Priority: HIGHEST for action port [ 818.008204] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 with Priority: HIGHEST for action security_group_rules [ 818.008333] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 with Priority: HIGHEST for action security_group_members [ 818.008426] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa0f5e4e-90f9-4185-b78b-79c396679750 with Priority: HIGHEST for action port [ 818.008689] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f54639a3-c11e-4833-b47a-e0b477c46dd5 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.009258] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.009328] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.009615] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.010656] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f54639a3-c11e-4833-b47a-e0b477c46dd5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.010656] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-f54639a3-c11e-4833-b47a-e0b477c46dd5 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.010985] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.010985] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.011201] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.011927] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.011927] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.012251] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.012251] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.012251] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.013976] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f54639a3-c11e-4833-b47a-e0b477c46dd5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.013976] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-fa0f5e4e-90f9-4185-b78b-79c396679750 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.013976] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fa0f5e4e-90f9-4185-b78b-79c396679750" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.013976] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fa0f5e4e-90f9-4185-b78b-79c396679750" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.014201] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fa0f5e4e-90f9-4185-b78b-79c396679750" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.014201] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa0f5e4e-90f9-4185-b78b-79c396679750',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.517447] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fa0f5e4e-90f9-4185-b78b-79c396679750 with status ACTIVE [ 818.517447] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.517447] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.517447] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.517447] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.517447] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.517864] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.517864] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.517864] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.517958] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.518070] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.518291] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.518408] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.518408] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.518558] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.519511] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.519511] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fa0f5e4e-90f9-4185-b78b-79c396679750 is going to be updated. [ 818.520380] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-f54639a3-c11e-4833-b47a-e0b477c46dd5 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.521230] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.522076] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f54639a3-c11e-4833-b47a-e0b477c46dd5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.556927] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.556927] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.556927] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.557983] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.557983] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.557983] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fa0f5e4e-90f9-4185-b78b-79c396679750" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.025298] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f54639a3-c11e-4833-b47a-e0b477c46dd5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.529309] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.529611] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.529611] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.529814] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.529906] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.529999] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 is going to be created. [ 819.560896] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.561125] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.561125] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.561313] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.561475] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.581658] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 in Status: UNINITIALIZED for 2s [ 819.663958] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cca6e4dd-68c9-4fd2-8e1a-cda645da02e4 in Status: SUCCESS [ 819.664217] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cca6e4dd-68c9-4fd2-8e1a-cda645da02e4 deletion is rescheduled due to dependency. [ 819.664274] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cca6e4dd-68c9-4fd2-8e1a-cda645da02e4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.123910] env[70392]: INFO networking_nsxv3.common.synchronization [req-0b31b45b-de6f-4171-b7a2-e7fcc1bf69fb req-2483b797-1f37-4744-bd5f-7892cac837c7 tempest-ServerGroupTestJSON-485529314 tempest-ServerGroupTestJSON-485529314-project-member] Enqueued Resource ID: 839b66b0-e5ba-4f94-b08b-508956410270 with Priority: HIGHEST for action security_group_members [ 820.129296] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 839b66b0-e5ba-4f94-b08b-508956410270 with Priority: HIGHEST for action security_group_members [ 820.129296] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-839b66b0-e5ba-4f94-b08b-508956410270 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.129296] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-839b66b0-e5ba-4f94-b08b-508956410270" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.129296] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-839b66b0-e5ba-4f94-b08b-508956410270" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.129296] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-839b66b0-e5ba-4f94-b08b-508956410270" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.129296] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.129296] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.129296] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.129296] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.129296] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.129296] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('839b66b0-e5ba-4f94-b08b-508956410270',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.632204] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.632462] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.632462] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.632524] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.634282] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.634282] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.634282] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.634282] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.634282] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.634282] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.634282] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 839b66b0-e5ba-4f94-b08b-508956410270 is going to be updated. [ 820.666540] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.666540] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.666540] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.666540] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.666540] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.677076] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 839b66b0-e5ba-4f94-b08b-508956410270 in Status: IN_PROGRESS for 2s [ 820.748141] env[70392]: INFO networking_nsxv3.common.synchronization [req-aeb303a8-cefd-44e8-a825-5cfc3ca1b10a req-a5ba885e-0d68-49fb-afc5-708274b23399 tempest-DeleteServersTestJSON-1676313022 tempest-DeleteServersTestJSON-1676313022-project-member] Enqueued Resource ID: ce79170a-31ce-429e-8e08-a911557872f4 with Priority: HIGHEST for action security_group_members [ 820.748141] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce79170a-31ce-429e-8e08-a911557872f4 with Priority: HIGHEST for action security_group_members [ 820.749031] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce79170a-31ce-429e-8e08-a911557872f4 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.749031] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.749031] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.749220] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.749423] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.749575] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.749649] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.749834] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.749955] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.750081] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce79170a-31ce-429e-8e08-a911557872f4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.034934] env[70392]: INFO networking_nsxv3.common.synchronization [None req-f38c58dd-dd58-431b-af69-f29f8426f8e9 None None] Enqueued Resource ID: 72b44547-6a84-4dce-90d9-e647869df4b1 with Priority: HIGHEST for action port [ 821.035178] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72b44547-6a84-4dce-90d9-e647869df4b1 with Priority: HIGHEST for action port [ 821.035737] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-72b44547-6a84-4dce-90d9-e647869df4b1 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.035915] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-72b44547-6a84-4dce-90d9-e647869df4b1" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.035915] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-72b44547-6a84-4dce-90d9-e647869df4b1" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.036181] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-72b44547-6a84-4dce-90d9-e647869df4b1" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.036257] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72b44547-6a84-4dce-90d9-e647869df4b1',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.206899] env[70392]: INFO networking_nsxv3.common.synchronization [req-76ba653f-1aab-408e-8322-4ced401f22c9 req-57b9f7bf-9bcd-40d0-9134-0ce32687faed tempest-ServersAdminTestJSON-721710769 tempest-ServersAdminTestJSON-721710769-project-member] Enqueued Resource ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 with Priority: HIGHEST for action security_group_members [ 821.207558] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 with Priority: HIGHEST for action security_group_members [ 821.207882] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-f54639a3-c11e-4833-b47a-e0b477c46dd5 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.207983] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.255961] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.256190] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.256284] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.256508] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.256601] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.256819] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.256903] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.256970] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.257172] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.257269] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.257400] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce79170a-31ce-429e-8e08-a911557872f4 is going to be updated. [ 821.295245] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.295245] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.295245] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.295428] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.295635] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.304649] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce79170a-31ce-429e-8e08-a911557872f4 in Status: IN_PROGRESS for 2s [ 821.542422] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 72b44547-6a84-4dce-90d9-e647869df4b1 [ 821.543784] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.543784] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.543784] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.543784] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.543784] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.543784] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:72b44547-6a84-4dce-90d9-e647869df4b1 already deleted. [ 821.543784] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-72b44547-6a84-4dce-90d9-e647869df4b1" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.593823] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 in Status: SUCCESS [ 821.594099] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.594289] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.594778] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.594778] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.594960] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.594960] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.595091] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.595138] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.595207] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.595304] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f54639a3-c11e-4833-b47a-e0b477c46dd5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.596217] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.596395] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.596574] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.596726] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.596821] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.597040] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.597040] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.597434] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f54639a3-c11e-4833-b47a-e0b477c46dd5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.848122] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-880 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.848398] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-880" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.849719] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-880" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.849719] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-880" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.849915] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.850206] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.850430] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.850811] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.851403] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.851754] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 821.851973] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 821.852214] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 821.852959] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 821.854023] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 821.854023] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 821.854023] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 821.879047] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 821.879194] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 821.879337] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 821.879567] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-880" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.879934] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-635b0136-7b6f-43c8-b65f-1f7cfda51dac taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.880133] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-635b0136-7b6f-43c8-b65f-1f7cfda51dac" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.880255] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-635b0136-7b6f-43c8-b65f-1f7cfda51dac" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.880617] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-635b0136-7b6f-43c8-b65f-1f7cfda51dac" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.880765] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('635b0136-7b6f-43c8-b65f-1f7cfda51dac',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.099442] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-f54639a3-c11e-4833-b47a-e0b477c46dd5 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.099442] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.099736] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f54639a3-c11e-4833-b47a-e0b477c46dd5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.383577] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.383817] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.384020] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.384283] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.384444] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.384606] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 635b0136-7b6f-43c8-b65f-1f7cfda51dac not found, creating... [ 822.384882] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.385057] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.385181] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.386121] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.386121] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.386121] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.386121] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.389117] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.389117] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.389117] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.389117] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 635b0136-7b6f-43c8-b65f-1f7cfda51dac is going to be created. [ 822.422533] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.422533] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.422533] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.422533] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.422533] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.422533] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-635b0136-7b6f-43c8-b65f-1f7cfda51dac" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.604760] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f54639a3-c11e-4833-b47a-e0b477c46dd5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.688862] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 839b66b0-e5ba-4f94-b08b-508956410270 in Status: SUCCESS [ 822.689135] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 839b66b0-e5ba-4f94-b08b-508956410270 deletion is rescheduled due to dependency. [ 822.689238] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-839b66b0-e5ba-4f94-b08b-508956410270" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.107867] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.108333] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.108333] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.108333] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.108428] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.108529] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 is going to be updated. [ 823.144864] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.145071] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.145116] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.145325] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.145473] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.157169] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 in Status: IN_PROGRESS for 2s [ 823.216245] env[70392]: INFO networking_nsxv3.common.synchronization [None req-54b05f11-0de0-4fdb-bfb9-4c0bdf69399d None None] Enqueued Resource ID: 97a4ce84-971b-4655-80bb-68c263d2c276 with Priority: HIGHEST for action port [ 823.217374] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97a4ce84-971b-4655-80bb-68c263d2c276 with Priority: HIGHEST for action port [ 823.217600] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-97a4ce84-971b-4655-80bb-68c263d2c276 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.217783] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-97a4ce84-971b-4655-80bb-68c263d2c276" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.217783] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-97a4ce84-971b-4655-80bb-68c263d2c276" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.217999] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-97a4ce84-971b-4655-80bb-68c263d2c276" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.218093] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97a4ce84-971b-4655-80bb-68c263d2c276',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.286820] env[70392]: INFO networking_nsxv3.common.synchronization [req-76ba653f-1aab-408e-8322-4ced401f22c9 req-1cdcaf13-0c79-4006-9125-77e80aab455a service nova] Enqueued Resource ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 with Priority: HIGHEST for action security_group_rules [ 823.287014] env[70392]: INFO networking_nsxv3.common.synchronization [req-76ba653f-1aab-408e-8322-4ced401f22c9 req-1cdcaf13-0c79-4006-9125-77e80aab455a service nova] Enqueued Resource ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 with Priority: HIGHEST for action security_group_members [ 823.287168] env[70392]: INFO networking_nsxv3.common.synchronization [req-76ba653f-1aab-408e-8322-4ced401f22c9 req-1cdcaf13-0c79-4006-9125-77e80aab455a service nova] Enqueued Resource ID: 635b0136-7b6f-43c8-b65f-1f7cfda51dac with Priority: HIGHEST for action port [ 823.287441] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 with Priority: HIGHEST for action security_group_rules [ 823.287550] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 with Priority: HIGHEST for action security_group_members [ 823.287681] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 635b0136-7b6f-43c8-b65f-1f7cfda51dac with Priority: HIGHEST for action port [ 823.288631] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f54639a3-c11e-4833-b47a-e0b477c46dd5 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.288751] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.288958] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-f54639a3-c11e-4833-b47a-e0b477c46dd5 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.289056] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.289236] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-635b0136-7b6f-43c8-b65f-1f7cfda51dac taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.289339] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-635b0136-7b6f-43c8-b65f-1f7cfda51dac" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.289404] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-635b0136-7b6f-43c8-b65f-1f7cfda51dac" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.289713] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-635b0136-7b6f-43c8-b65f-1f7cfda51dac" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.289867] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('635b0136-7b6f-43c8-b65f-1f7cfda51dac',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.316579] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce79170a-31ce-429e-8e08-a911557872f4 in Status: SUCCESS [ 823.316579] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce79170a-31ce-429e-8e08-a911557872f4 deletion is rescheduled due to dependency. [ 823.316579] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.649478] env[70392]: INFO networking_nsxv3.common.synchronization [None req-12d414fe-dda6-41bf-a1d0-b728e2cb11f7 None None] Enqueued Resource ID: 3655271e-1f63-4acb-a073-96b69610ccb6 with Priority: HIGHEST for action port [ 823.649478] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3655271e-1f63-4acb-a073-96b69610ccb6 with Priority: HIGHEST for action port [ 823.649478] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-3655271e-1f63-4acb-a073-96b69610ccb6 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.649478] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3655271e-1f63-4acb-a073-96b69610ccb6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.649478] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3655271e-1f63-4acb-a073-96b69610ccb6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.649478] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3655271e-1f63-4acb-a073-96b69610ccb6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.649478] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3655271e-1f63-4acb-a073-96b69610ccb6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.724983] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 97a4ce84-971b-4655-80bb-68c263d2c276 [ 823.728020] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.728020] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.728020] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.728020] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.728020] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.728020] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:97a4ce84-971b-4655-80bb-68c263d2c276 already deleted. [ 823.728020] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-97a4ce84-971b-4655-80bb-68c263d2c276" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.792815] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 635b0136-7b6f-43c8-b65f-1f7cfda51dac with status ACTIVE [ 823.792815] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.794565] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.794565] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.794565] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.794811] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.794811] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.796101] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.796101] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.796101] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.796101] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.796101] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.796101] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.796101] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.796101] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.796101] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.796101] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 635b0136-7b6f-43c8-b65f-1f7cfda51dac is going to be updated. [ 823.819273] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.819428] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.819536] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.819803] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.819914] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.820091] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-635b0136-7b6f-43c8-b65f-1f7cfda51dac" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.017200] env[70392]: INFO networking_nsxv3.common.synchronization [req-b38beff4-9b01-4401-b30b-cd0a0d68dd39 req-28e855d3-2856-4db5-8d6e-e5f78b9bc17b tempest-ServerRescueNegativeTestJSON-197938596 tempest-ServerRescueNegativeTestJSON-197938596-project-member] Enqueued Resource ID: eee84844-ea79-48de-9294-c53a759dc328 with Priority: HIGHEST for action security_group_members [ 824.020116] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eee84844-ea79-48de-9294-c53a759dc328 with Priority: HIGHEST for action security_group_members [ 824.020116] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-eee84844-ea79-48de-9294-c53a759dc328 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.020116] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.020116] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.020116] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.020116] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.020116] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.020116] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.020116] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.020116] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.020116] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eee84844-ea79-48de-9294-c53a759dc328',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.156925] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3655271e-1f63-4acb-a073-96b69610ccb6 [ 824.157265] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.157436] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.157492] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.157868] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.157868] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.157969] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3655271e-1f63-4acb-a073-96b69610ccb6 already deleted. [ 824.158008] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3655271e-1f63-4acb-a073-96b69610ccb6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.525674] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.525849] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.525919] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.526747] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.526920] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.527196] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.527301] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.527367] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.527556] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.527635] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.527725] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eee84844-ea79-48de-9294-c53a759dc328 already deleted. [ 824.527816] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.642756] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-553 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.642965] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-553" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.643108] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-553" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.643431] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-553" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.645021] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.645021] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.645021] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.645021] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.645021] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.645021] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 824.645021] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 824.645021] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 824.645021] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 824.645753] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 824.648293] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 824.648293] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 824.667234] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 824.667396] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 824.667531] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 824.667736] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-553" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.668780] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-cb87d0f6-369b-40d2-ae6d-af5561dae639 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.668780] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-cb87d0f6-369b-40d2-ae6d-af5561dae639" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.668780] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-cb87d0f6-369b-40d2-ae6d-af5561dae639" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.669073] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-cb87d0f6-369b-40d2-ae6d-af5561dae639" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.669073] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb87d0f6-369b-40d2-ae6d-af5561dae639',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.721827] env[70392]: INFO networking_nsxv3.common.synchronization [None req-ba68a6cb-7f92-479e-96cf-cd9a5ec5b0c0 tempest-AttachVolumeNegativeTest-772339566 tempest-AttachVolumeNegativeTest-772339566-project-member] Enqueued Resource ID: 3b776bd0-c07d-4db7-beb4-bf0b0360a21c with Priority: HIGHEST for action security_group_rules [ 824.723500] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b776bd0-c07d-4db7-beb4-bf0b0360a21c with Priority: HIGHEST for action security_group_rules [ 824.723500] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3b776bd0-c07d-4db7-beb4-bf0b0360a21c taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.723500] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3b776bd0-c07d-4db7-beb4-bf0b0360a21c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.723500] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3b776bd0-c07d-4db7-beb4-bf0b0360a21c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.723500] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3b776bd0-c07d-4db7-beb4-bf0b0360a21c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.723500] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3b776bd0-c07d-4db7-beb4-bf0b0360a21c',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.829775] env[70392]: INFO networking_nsxv3.common.synchronization [None req-2fa4d763-f1a7-417f-9d82-9bf86267dfb9 tempest-AttachVolumeNegativeTest-772339566 tempest-AttachVolumeNegativeTest-772339566-project-member] Enqueued Resource ID: 3b776bd0-c07d-4db7-beb4-bf0b0360a21c with Priority: HIGHEST for action security_group_rules [ 824.830463] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b776bd0-c07d-4db7-beb4-bf0b0360a21c with Priority: HIGHEST for action security_group_rules [ 824.830824] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3b776bd0-c07d-4db7-beb4-bf0b0360a21c taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.830976] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3b776bd0-c07d-4db7-beb4-bf0b0360a21c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.169770] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 in Status: SUCCESS [ 825.170149] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.170327] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.170587] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.170825] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.170978] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.171088] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.171288] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.171405] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.171526] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.171726] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-f54639a3-c11e-4833-b47a-e0b477c46dd5 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.171865] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.171958] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.172145] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.172323] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.172449] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.172536] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.172715] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.172829] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.172951] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.173218] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f54639a3-c11e-4833-b47a-e0b477c46dd5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.174558] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.174780] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.174940] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.175220] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.175404] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.175591] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port cb87d0f6-369b-40d2-ae6d-af5561dae639 not found, creating... [ 825.175875] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.176092] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.176246] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.176728] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.176728] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.176979] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.177191] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.177620] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.177884] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.178144] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.178290] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: cb87d0f6-369b-40d2-ae6d-af5561dae639 is going to be created. [ 825.179364] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.179584] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.179882] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.179882] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.179994] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.180190] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.180356] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.180410] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f54639a3-c11e-4833-b47a-e0b477c46dd5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.207769] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.208093] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.208235] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.208691] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.208961] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.209292] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-cb87d0f6-369b-40d2-ae6d-af5561dae639" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.247456] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.247713] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.247791] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.248011] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.248109] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.248206] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3b776bd0-c07d-4db7-beb4-bf0b0360a21c already deleted. [ 825.248291] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3b776bd0-c07d-4db7-beb4-bf0b0360a21c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.248449] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3b776bd0-c07d-4db7-beb4-bf0b0360a21c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.248606] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3b776bd0-c07d-4db7-beb4-bf0b0360a21c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.248691] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3b776bd0-c07d-4db7-beb4-bf0b0360a21c',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.682335] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f54639a3-c11e-4833-b47a-e0b477c46dd5: rpc.has_security_group_logging(os_id): False [ 825.683765] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f54639a3-c11e-4833-b47a-e0b477c46dd5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.703015] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.703015] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.703015] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.703015] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.703015] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.703015] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.703015] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.703015] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.703015] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.703015] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.703015] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.703015] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.703015] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.703506] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.703506] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.703506] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.703506] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.703618] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.703809] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.703809] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.703809] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 is going to be created. [ 825.768716] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.768873] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.768940] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.769170] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.769295] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.769349] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3b776bd0-c07d-4db7-beb4-bf0b0360a21c already deleted. [ 825.770152] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3b776bd0-c07d-4db7-beb4-bf0b0360a21c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.781406] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.781555] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.781615] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.781814] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.782042] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.795360] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 in Status: IN_PROGRESS for 2s [ 826.040518] env[70392]: INFO networking_nsxv3.common.synchronization [req-b38beff4-9b01-4401-b30b-cd0a0d68dd39 req-83ffe466-9def-4211-83b9-c00baa28cf2b service nova] Enqueued Resource ID: eee84844-ea79-48de-9294-c53a759dc328 with Priority: HIGHEST for action security_group_rules [ 826.040518] env[70392]: INFO networking_nsxv3.common.synchronization [req-b38beff4-9b01-4401-b30b-cd0a0d68dd39 req-83ffe466-9def-4211-83b9-c00baa28cf2b service nova] Enqueued Resource ID: eee84844-ea79-48de-9294-c53a759dc328 with Priority: HIGHEST for action security_group_members [ 826.040518] env[70392]: INFO networking_nsxv3.common.synchronization [req-b38beff4-9b01-4401-b30b-cd0a0d68dd39 req-83ffe466-9def-4211-83b9-c00baa28cf2b service nova] Enqueued Resource ID: cb87d0f6-369b-40d2-ae6d-af5561dae639 with Priority: HIGHEST for action port [ 826.040518] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eee84844-ea79-48de-9294-c53a759dc328 with Priority: HIGHEST for action security_group_rules [ 826.040518] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eee84844-ea79-48de-9294-c53a759dc328 with Priority: HIGHEST for action security_group_members [ 826.040518] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb87d0f6-369b-40d2-ae6d-af5561dae639 with Priority: HIGHEST for action port [ 826.041715] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eee84844-ea79-48de-9294-c53a759dc328 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.041859] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.042152] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.042270] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.042359] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eee84844-ea79-48de-9294-c53a759dc328',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.043696] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-eee84844-ea79-48de-9294-c53a759dc328 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.043820] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.043941] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.044101] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.044271] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.044373] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.044436] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.044589] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.044676] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.044766] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eee84844-ea79-48de-9294-c53a759dc328',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.046617] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-cb87d0f6-369b-40d2-ae6d-af5561dae639 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.046879] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cb87d0f6-369b-40d2-ae6d-af5561dae639" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.047059] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cb87d0f6-369b-40d2-ae6d-af5561dae639" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.047982] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cb87d0f6-369b-40d2-ae6d-af5561dae639" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.047982] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb87d0f6-369b-40d2-ae6d-af5561dae639',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.189109] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f54639a3-c11e-4833-b47a-e0b477c46dd5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.293357] env[70392]: INFO networking_nsxv3.common.synchronization [None req-119bad3c-1694-4f88-a482-1c474f427d5d None None] Enqueued Resource ID: 4baa0809-0a3d-46b9-b221-47875fd9f1fc with Priority: HIGHEST for action port [ 826.294427] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4baa0809-0a3d-46b9-b221-47875fd9f1fc with Priority: HIGHEST for action port [ 826.294759] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-4baa0809-0a3d-46b9-b221-47875fd9f1fc taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.294884] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4baa0809-0a3d-46b9-b221-47875fd9f1fc" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.294951] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4baa0809-0a3d-46b9-b221-47875fd9f1fc" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.295406] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4baa0809-0a3d-46b9-b221-47875fd9f1fc" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.295495] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4baa0809-0a3d-46b9-b221-47875fd9f1fc',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.552154] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eee84844-ea79-48de-9294-c53a759dc328',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.553116] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-eee84844-ea79-48de-9294-c53a759dc328 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.553116] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.553116] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cb87d0f6-369b-40d2-ae6d-af5561dae639 with status ACTIVE [ 826.553116] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.553328] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.553328] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.553436] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.553467] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.553649] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.553741] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.553819] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.553978] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.554090] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.554277] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.554367] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.554426] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.554562] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.554635] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.554717] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cb87d0f6-369b-40d2-ae6d-af5561dae639 is going to be updated. [ 826.575892] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.576289] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.576289] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.576289] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.577069] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.577320] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cb87d0f6-369b-40d2-ae6d-af5561dae639" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.693245] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.693411] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.693496] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.693953] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.693953] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.693953] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 is going to be updated. [ 826.729577] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.729577] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.729577] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.729577] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.729777] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.748072] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 in Status: IN_PROGRESS for 2s [ 826.798406] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4baa0809-0a3d-46b9-b221-47875fd9f1fc [ 826.798628] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.798767] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.798837] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.799056] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.799149] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.799244] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4baa0809-0a3d-46b9-b221-47875fd9f1fc already deleted. [ 826.799322] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4baa0809-0a3d-46b9-b221-47875fd9f1fc" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.058266] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eee84844-ea79-48de-9294-c53a759dc328',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.561347] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.561706] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.561706] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.564610] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.564610] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.564610] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eee84844-ea79-48de-9294-c53a759dc328 is going to be created. [ 827.588426] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.588566] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.588634] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.588841] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.588996] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.601672] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eee84844-ea79-48de-9294-c53a759dc328 in Status: UNINITIALIZED for 2s [ 827.810785] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 in Status: SUCCESS [ 827.810966] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.811273] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.811590] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.811838] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f54639a3-c11e-4833-b47a-e0b477c46dd5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.314971] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-f54639a3-c11e-4833-b47a-e0b477c46dd5 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.315192] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.759404] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 in Status: SUCCESS [ 828.759764] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.760068] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.760777] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.760777] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.764071] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.764310] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.764538] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.764672] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.764820] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.766412] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f54639a3-c11e-4833-b47a-e0b477c46dd5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.180905] env[70392]: INFO networking_nsxv3.common.synchronization [req-3404b2d6-79cf-4fc1-b4ac-df3781e83097 req-466affe8-8866-422f-97d7-acb22091ef41 tempest-ImagesOneServerTestJSON-441499339 tempest-ImagesOneServerTestJSON-441499339-project-member] Enqueued Resource ID: 56238df1-04a7-4a59-9d0f-ea911fb29f15 with Priority: HIGHEST for action security_group_members [ 829.181147] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56238df1-04a7-4a59-9d0f-ea911fb29f15 with Priority: HIGHEST for action security_group_members [ 829.181805] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-56238df1-04a7-4a59-9d0f-ea911fb29f15 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.181805] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56238df1-04a7-4a59-9d0f-ea911fb29f15" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.181805] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56238df1-04a7-4a59-9d0f-ea911fb29f15" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.183287] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56238df1-04a7-4a59-9d0f-ea911fb29f15" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.183287] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.183287] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.183287] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.183287] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.183287] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.183287] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('56238df1-04a7-4a59-9d0f-ea911fb29f15',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.268433] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-f54639a3-c11e-4833-b47a-e0b477c46dd5 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.269417] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.269417] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.269417] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.269417] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.269417] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.269772] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.269772] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.269772] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.269875] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.269984] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-f54639a3-c11e-4833-b47a-e0b477c46dd5 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.270096] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.270159] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.270302] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.270436] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.270525] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.270580] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.270722] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.270797] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.270872] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.270959] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f54639a3-c11e-4833-b47a-e0b477c46dd5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.612160] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eee84844-ea79-48de-9294-c53a759dc328 in Status: SUCCESS [ 829.612431] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.612556] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.612767] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.612962] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.613117] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.613203] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.613362] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.613544] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.613544] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.613651] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eee84844-ea79-48de-9294-c53a759dc328',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.688661] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.688661] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.688661] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.688661] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.688661] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.688661] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.688661] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.688661] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.688661] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.688661] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.688661] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56238df1-04a7-4a59-9d0f-ea911fb29f15 already deleted. [ 829.688661] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56238df1-04a7-4a59-9d0f-ea911fb29f15" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.693666] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-547 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.693666] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-547" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.693666] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-547" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.693666] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-547" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.693666] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.693666] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.693666] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.694243] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.694564] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.694880] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 829.695118] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 829.695321] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 829.695534] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 829.695771] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 829.696020] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 829.696253] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 829.719148] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 829.719148] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 829.719148] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 829.719148] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-547" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.719148] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-0eb06e40-4709-4cc8-8919-d781b20d15ed taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.719148] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-0eb06e40-4709-4cc8-8919-d781b20d15ed" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.719148] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-0eb06e40-4709-4cc8-8919-d781b20d15ed" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.719148] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-0eb06e40-4709-4cc8-8919-d781b20d15ed" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.719148] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0eb06e40-4709-4cc8-8919-d781b20d15ed',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.773444] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f54639a3-c11e-4833-b47a-e0b477c46dd5: rpc.has_security_group_logging(os_id): False [ 829.793209] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.793209] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.793209] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.793209] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.793209] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.793209] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.793209] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.793209] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.793209] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.793209] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.793209] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.793209] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.793209] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.794628] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.794628] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.794763] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.794820] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.794851] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.795027] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.795126] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.795290] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 is going to be updated. [ 829.867578] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.867752] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.867810] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.868185] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.868185] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.886237] env[70392]: INFO networking_nsxv3.common.synchronization [None req-76be7a23-f510-4095-bca8-8026560692bf None None] Enqueued Resource ID: 3b57e94b-9076-4d1e-8b75-cc3a135ccd94 with Priority: HIGHEST for action port [ 829.887167] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 in Status: IN_PROGRESS for 2s [ 829.887303] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b57e94b-9076-4d1e-8b75-cc3a135ccd94 with Priority: HIGHEST for action port [ 829.889068] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-3b57e94b-9076-4d1e-8b75-cc3a135ccd94 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.889216] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3b57e94b-9076-4d1e-8b75-cc3a135ccd94" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.889280] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3b57e94b-9076-4d1e-8b75-cc3a135ccd94" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.889550] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3b57e94b-9076-4d1e-8b75-cc3a135ccd94" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.890102] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b57e94b-9076-4d1e-8b75-cc3a135ccd94',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.116350] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-eee84844-ea79-48de-9294-c53a759dc328 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.116526] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.116526] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.116878] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.116992] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.117461] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.117461] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.117608] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.117608] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.117695] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.117868] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-eee84844-ea79-48de-9294-c53a759dc328 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.117999] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.118072] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.118774] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.118858] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.118926] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.119101] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.119234] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.119319] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.119426] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.119526] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eee84844-ea79-48de-9294-c53a759dc328',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.221788] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.222027] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.222208] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.222564] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.222794] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.223010] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 0eb06e40-4709-4cc8-8919-d781b20d15ed not found, creating... [ 830.223369] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.223630] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.223806] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.224134] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.224333] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.224734] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.224972] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.225159] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.225545] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.225735] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.225943] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 0eb06e40-4709-4cc8-8919-d781b20d15ed is going to be created. [ 830.252528] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.252821] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.252999] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.253412] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.253729] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.253993] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-0eb06e40-4709-4cc8-8919-d781b20d15ed" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.393752] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3b57e94b-9076-4d1e-8b75-cc3a135ccd94 [ 830.395351] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.395638] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.395750] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.396016] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.396152] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.396287] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3b57e94b-9076-4d1e-8b75-cc3a135ccd94 already deleted. [ 830.396401] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3b57e94b-9076-4d1e-8b75-cc3a135ccd94" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.623666] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eee84844-ea79-48de-9294-c53a759dc328: rpc.has_security_group_logging(os_id): False [ 830.647947] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.648222] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.648222] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.648431] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.648493] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.648716] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.648813] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.648872] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.649303] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.649303] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.649303] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.649451] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.649451] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.649549] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.649625] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.649885] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.649984] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.650055] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.650199] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.650276] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.650360] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eee84844-ea79-48de-9294-c53a759dc328 is going to be created. [ 830.757982] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.758163] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.758236] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.758477] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.759050] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.774847] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eee84844-ea79-48de-9294-c53a759dc328 in Status: IN_PROGRESS for 2s [ 831.430850] env[70392]: INFO networking_nsxv3.common.synchronization [req-3404b2d6-79cf-4fc1-b4ac-df3781e83097 req-2adb08f4-bbb7-41fd-98fe-2f2b9d267af5 service nova] Enqueued Resource ID: 56238df1-04a7-4a59-9d0f-ea911fb29f15 with Priority: HIGHEST for action security_group_rules [ 831.431032] env[70392]: INFO networking_nsxv3.common.synchronization [req-3404b2d6-79cf-4fc1-b4ac-df3781e83097 req-2adb08f4-bbb7-41fd-98fe-2f2b9d267af5 service nova] Enqueued Resource ID: 56238df1-04a7-4a59-9d0f-ea911fb29f15 with Priority: HIGHEST for action security_group_members [ 831.431319] env[70392]: INFO networking_nsxv3.common.synchronization [req-3404b2d6-79cf-4fc1-b4ac-df3781e83097 req-2adb08f4-bbb7-41fd-98fe-2f2b9d267af5 service nova] Enqueued Resource ID: 0eb06e40-4709-4cc8-8919-d781b20d15ed with Priority: HIGHEST for action port [ 831.431886] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56238df1-04a7-4a59-9d0f-ea911fb29f15 with Priority: HIGHEST for action security_group_rules [ 831.432068] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56238df1-04a7-4a59-9d0f-ea911fb29f15 with Priority: HIGHEST for action security_group_members [ 831.432068] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0eb06e40-4709-4cc8-8919-d781b20d15ed with Priority: HIGHEST for action port [ 831.432352] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-56238df1-04a7-4a59-9d0f-ea911fb29f15 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.432475] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-56238df1-04a7-4a59-9d0f-ea911fb29f15" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.432541] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-56238df1-04a7-4a59-9d0f-ea911fb29f15" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.432789] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-56238df1-04a7-4a59-9d0f-ea911fb29f15" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.432900] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('56238df1-04a7-4a59-9d0f-ea911fb29f15',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.434210] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-56238df1-04a7-4a59-9d0f-ea911fb29f15 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.434303] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56238df1-04a7-4a59-9d0f-ea911fb29f15" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.434369] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56238df1-04a7-4a59-9d0f-ea911fb29f15" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.434548] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56238df1-04a7-4a59-9d0f-ea911fb29f15" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.434700] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.434794] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.434969] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.435034] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.435091] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.435185] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('56238df1-04a7-4a59-9d0f-ea911fb29f15',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.435957] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-0eb06e40-4709-4cc8-8919-d781b20d15ed taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.436077] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0eb06e40-4709-4cc8-8919-d781b20d15ed" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.436144] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0eb06e40-4709-4cc8-8919-d781b20d15ed" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.436322] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0eb06e40-4709-4cc8-8919-d781b20d15ed" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.436390] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0eb06e40-4709-4cc8-8919-d781b20d15ed',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.903350] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 in Status: SUCCESS [ 831.904384] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.912035] env[70392]: INFO networking_nsxv3.common.synchronization [req-c738828f-487c-4049-a2ce-d1c54dffc1fe req-03bcd016-c38e-45cc-b8df-330f3a98f9d8 tempest-ServerRescueTestJSON-347177866 tempest-ServerRescueTestJSON-347177866-project-member] Enqueued Resource ID: 03a8a1fe-a465-4403-8e2c-2170f54b59a0 with Priority: HIGHEST for action security_group_members [ 831.912035] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03a8a1fe-a465-4403-8e2c-2170f54b59a0 with Priority: HIGHEST for action security_group_members [ 831.912035] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-03a8a1fe-a465-4403-8e2c-2170f54b59a0 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.912035] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03a8a1fe-a465-4403-8e2c-2170f54b59a0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.912035] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03a8a1fe-a465-4403-8e2c-2170f54b59a0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.912906] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03a8a1fe-a465-4403-8e2c-2170f54b59a0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.912999] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.914289] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.914289] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.914289] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.914289] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.914289] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('03a8a1fe-a465-4403-8e2c-2170f54b59a0',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.937949] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-56238df1-04a7-4a59-9d0f-ea911fb29f15 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.938431] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56238df1-04a7-4a59-9d0f-ea911fb29f15" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.938431] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('56238df1-04a7-4a59-9d0f-ea911fb29f15',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.939400] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0eb06e40-4709-4cc8-8919-d781b20d15ed with status ACTIVE [ 831.939522] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.939724] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.939860] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.940128] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.940216] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.940421] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.940555] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.940636] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.940860] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.940978] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.941226] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.941357] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.941447] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.941651] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.941751] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.941864] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0eb06e40-4709-4cc8-8919-d781b20d15ed is going to be updated. [ 831.972239] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.972239] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.972239] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.972239] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.972907] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.973251] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0eb06e40-4709-4cc8-8919-d781b20d15ed" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.411888] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-726 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.412130] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-726" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.412246] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-726" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.412571] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-726" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.412833] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.413025] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.413318] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.413641] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.413750] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.413911] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 832.414171] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 832.414171] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 832.414922] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 832.415105] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 832.415227] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 832.415370] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 832.417354] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.417354] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.417354] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.417354] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.417354] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.417556] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.417556] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.417670] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.417809] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.417885] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.417972] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03a8a1fe-a465-4403-8e2c-2170f54b59a0 already deleted. [ 832.418271] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03a8a1fe-a465-4403-8e2c-2170f54b59a0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.440123] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 832.440294] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 832.440476] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 832.440618] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-726" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.441008] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-d438c75f-e4f5-4d71-96f7-034c52a9e12b taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.441190] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-d438c75f-e4f5-4d71-96f7-034c52a9e12b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.441400] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-d438c75f-e4f5-4d71-96f7-034c52a9e12b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.441627] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-d438c75f-e4f5-4d71-96f7-034c52a9e12b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.441768] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d438c75f-e4f5-4d71-96f7-034c52a9e12b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.446561] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('56238df1-04a7-4a59-9d0f-ea911fb29f15',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.481903] env[70392]: INFO networking_nsxv3.common.synchronization [None req-4aa7f3eb-a5d4-411f-a660-f5f1613a9a3a None None] Enqueued Resource ID: 9c58444f-152c-4376-9988-63d59cb773f4 with Priority: HIGHEST for action port [ 832.482728] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c58444f-152c-4376-9988-63d59cb773f4 with Priority: HIGHEST for action port [ 832.484085] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-9c58444f-152c-4376-9988-63d59cb773f4 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.484290] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9c58444f-152c-4376-9988-63d59cb773f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.484363] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9c58444f-152c-4376-9988-63d59cb773f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.484604] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9c58444f-152c-4376-9988-63d59cb773f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.484726] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c58444f-152c-4376-9988-63d59cb773f4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.788792] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eee84844-ea79-48de-9294-c53a759dc328 in Status: SUCCESS [ 832.788986] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.950272] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.950272] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.950272] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.950272] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.950272] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.950272] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port d438c75f-e4f5-4d71-96f7-034c52a9e12b not found, creating... [ 832.950272] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.950272] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.950272] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.950812] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.950812] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.950914] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.951085] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.951189] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.951394] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.951567] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.951662] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: d438c75f-e4f5-4d71-96f7-034c52a9e12b is going to be created. [ 832.954990] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.955134] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.955211] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.955397] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.955482] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.955571] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56238df1-04a7-4a59-9d0f-ea911fb29f15 is going to be created. [ 832.979389] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.979590] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.979915] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.980420] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.980542] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.980808] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-d438c75f-e4f5-4d71-96f7-034c52a9e12b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.987150] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.987329] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.987384] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.987610] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.987807] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.989021] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9c58444f-152c-4376-9988-63d59cb773f4 [ 832.989314] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.989314] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.989463] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.989551] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.989637] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.989744] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9c58444f-152c-4376-9988-63d59cb773f4 already deleted. [ 832.989876] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9c58444f-152c-4376-9988-63d59cb773f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.000165] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56238df1-04a7-4a59-9d0f-ea911fb29f15 in Status: UNINITIALIZED for 2s [ 833.138192] env[70392]: INFO networking_nsxv3.common.synchronization [None req-e8c1efbf-da24-4d9d-a10b-a58620bd5729 None None] Enqueued Resource ID: 1b0c0cbe-4a95-4c64-ab20-334d80f27396 with Priority: HIGHEST for action port [ 833.138565] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b0c0cbe-4a95-4c64-ab20-334d80f27396 with Priority: HIGHEST for action port [ 833.138962] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-1b0c0cbe-4a95-4c64-ab20-334d80f27396 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.139994] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1b0c0cbe-4a95-4c64-ab20-334d80f27396" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.140125] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1b0c0cbe-4a95-4c64-ab20-334d80f27396" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.140397] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1b0c0cbe-4a95-4c64-ab20-334d80f27396" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.140501] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b0c0cbe-4a95-4c64-ab20-334d80f27396',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.644101] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1b0c0cbe-4a95-4c64-ab20-334d80f27396 [ 833.644380] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.644578] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.644654] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.644879] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.645038] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.645177] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1b0c0cbe-4a95-4c64-ab20-334d80f27396 already deleted. [ 833.645276] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1b0c0cbe-4a95-4c64-ab20-334d80f27396" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.767488] env[70392]: INFO networking_nsxv3.common.synchronization [req-c738828f-487c-4049-a2ce-d1c54dffc1fe req-d83f9ead-3059-42ec-8ae7-dea7bac1de6c service nova] Enqueued Resource ID: 03a8a1fe-a465-4403-8e2c-2170f54b59a0 with Priority: HIGHEST for action security_group_rules [ 833.767619] env[70392]: INFO networking_nsxv3.common.synchronization [req-c738828f-487c-4049-a2ce-d1c54dffc1fe req-d83f9ead-3059-42ec-8ae7-dea7bac1de6c service nova] Enqueued Resource ID: 03a8a1fe-a465-4403-8e2c-2170f54b59a0 with Priority: HIGHEST for action security_group_members [ 833.767788] env[70392]: INFO networking_nsxv3.common.synchronization [req-c738828f-487c-4049-a2ce-d1c54dffc1fe req-d83f9ead-3059-42ec-8ae7-dea7bac1de6c service nova] Enqueued Resource ID: d438c75f-e4f5-4d71-96f7-034c52a9e12b with Priority: HIGHEST for action port [ 833.768043] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03a8a1fe-a465-4403-8e2c-2170f54b59a0 with Priority: HIGHEST for action security_group_rules [ 833.768168] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03a8a1fe-a465-4403-8e2c-2170f54b59a0 with Priority: HIGHEST for action security_group_members [ 833.768258] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d438c75f-e4f5-4d71-96f7-034c52a9e12b with Priority: HIGHEST for action port [ 833.768828] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-03a8a1fe-a465-4403-8e2c-2170f54b59a0 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.768971] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-03a8a1fe-a465-4403-8e2c-2170f54b59a0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.769028] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-03a8a1fe-a465-4403-8e2c-2170f54b59a0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.769305] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-03a8a1fe-a465-4403-8e2c-2170f54b59a0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.769389] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('03a8a1fe-a465-4403-8e2c-2170f54b59a0',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.770326] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-03a8a1fe-a465-4403-8e2c-2170f54b59a0 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.770480] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03a8a1fe-a465-4403-8e2c-2170f54b59a0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.770480] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03a8a1fe-a465-4403-8e2c-2170f54b59a0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.770570] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03a8a1fe-a465-4403-8e2c-2170f54b59a0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.772455] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.772573] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.772630] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.772792] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.772878] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.772969] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('03a8a1fe-a465-4403-8e2c-2170f54b59a0',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.773735] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-d438c75f-e4f5-4d71-96f7-034c52a9e12b taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.773861] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d438c75f-e4f5-4d71-96f7-034c52a9e12b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.773927] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d438c75f-e4f5-4d71-96f7-034c52a9e12b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.774055] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d438c75f-e4f5-4d71-96f7-034c52a9e12b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.774127] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d438c75f-e4f5-4d71-96f7-034c52a9e12b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.275624] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-03a8a1fe-a465-4403-8e2c-2170f54b59a0 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.275947] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03a8a1fe-a465-4403-8e2c-2170f54b59a0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.275947] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('03a8a1fe-a465-4403-8e2c-2170f54b59a0',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.276870] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d438c75f-e4f5-4d71-96f7-034c52a9e12b with status ACTIVE [ 834.277070] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.277187] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.277254] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.277457] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.278067] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.278067] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.278067] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.278067] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.278067] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.278067] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.279312] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.279312] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.279312] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.279312] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.279312] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.279312] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d438c75f-e4f5-4d71-96f7-034c52a9e12b is going to be updated. [ 834.300087] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.300257] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.300305] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.300512] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.300655] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.300929] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d438c75f-e4f5-4d71-96f7-034c52a9e12b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.783159] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('03a8a1fe-a465-4403-8e2c-2170f54b59a0',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.013067] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56238df1-04a7-4a59-9d0f-ea911fb29f15 in Status: SUCCESS [ 835.013493] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56238df1-04a7-4a59-9d0f-ea911fb29f15" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.015092] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56238df1-04a7-4a59-9d0f-ea911fb29f15" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.015092] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56238df1-04a7-4a59-9d0f-ea911fb29f15" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.015092] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.015092] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.015092] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.015092] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.015092] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.015865] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56238df1-04a7-4a59-9d0f-ea911fb29f15" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.015981] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('56238df1-04a7-4a59-9d0f-ea911fb29f15',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.176752] env[70392]: INFO networking_nsxv3.common.synchronization [None req-aafb8b2a-bb80-4686-8b72-abefc9a2894f None None] Enqueued Resource ID: 2ffac6f8-8243-4b40-ab5c-e62100fb96bb with Priority: HIGHEST for action port [ 835.177394] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ffac6f8-8243-4b40-ab5c-e62100fb96bb with Priority: HIGHEST for action port [ 835.178550] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-2ffac6f8-8243-4b40-ab5c-e62100fb96bb taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.178683] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2ffac6f8-8243-4b40-ab5c-e62100fb96bb" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.178737] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2ffac6f8-8243-4b40-ab5c-e62100fb96bb" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.179083] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2ffac6f8-8243-4b40-ab5c-e62100fb96bb" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.179190] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ffac6f8-8243-4b40-ab5c-e62100fb96bb',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.285499] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.285836] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.285836] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.285944] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.286049] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.286149] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03a8a1fe-a465-4403-8e2c-2170f54b59a0 is going to be created. [ 835.322376] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.322601] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.322711] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.323033] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.323347] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.341173] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03a8a1fe-a465-4403-8e2c-2170f54b59a0 in Status: UNINITIALIZED for 2s [ 835.518521] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-56238df1-04a7-4a59-9d0f-ea911fb29f15 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.518699] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56238df1-04a7-4a59-9d0f-ea911fb29f15" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.518813] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56238df1-04a7-4a59-9d0f-ea911fb29f15" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.519114] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56238df1-04a7-4a59-9d0f-ea911fb29f15" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.519321] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.519441] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.519507] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.519670] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.519782] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.519869] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56238df1-04a7-4a59-9d0f-ea911fb29f15" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.520134] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-56238df1-04a7-4a59-9d0f-ea911fb29f15 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.520243] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56238df1-04a7-4a59-9d0f-ea911fb29f15" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.520306] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56238df1-04a7-4a59-9d0f-ea911fb29f15" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.520453] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56238df1-04a7-4a59-9d0f-ea911fb29f15" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.520589] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.520680] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.520742] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.520880] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.520956] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.521479] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56238df1-04a7-4a59-9d0f-ea911fb29f15" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.521594] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('56238df1-04a7-4a59-9d0f-ea911fb29f15',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.681999] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2ffac6f8-8243-4b40-ab5c-e62100fb96bb [ 835.681999] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.682272] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.682272] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.682384] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.682480] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.682577] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2ffac6f8-8243-4b40-ab5c-e62100fb96bb already deleted. [ 835.682658] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2ffac6f8-8243-4b40-ab5c-e62100fb96bb" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.025017] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 56238df1-04a7-4a59-9d0f-ea911fb29f15: rpc.has_security_group_logging(os_id): False [ 836.044924] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.045134] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.045199] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.048965] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.048965] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.048965] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.048965] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.048965] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.048965] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.048965] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.048965] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.048965] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.048965] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.048965] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.048965] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.048965] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.048965] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.050022] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.050022] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.050022] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.050022] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 56238df1-04a7-4a59-9d0f-ea911fb29f15 is going to be created. [ 836.119976] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.120223] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.120223] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.120487] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.120685] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.133163] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 56238df1-04a7-4a59-9d0f-ea911fb29f15 in Status: IN_PROGRESS for 2s [ 837.351156] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03a8a1fe-a465-4403-8e2c-2170f54b59a0 in Status: SUCCESS [ 837.351490] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03a8a1fe-a465-4403-8e2c-2170f54b59a0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.353952] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03a8a1fe-a465-4403-8e2c-2170f54b59a0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.353952] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03a8a1fe-a465-4403-8e2c-2170f54b59a0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.353952] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.353952] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.353952] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.353952] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.353952] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.353952] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03a8a1fe-a465-4403-8e2c-2170f54b59a0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.353952] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('03a8a1fe-a465-4403-8e2c-2170f54b59a0',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.856959] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-03a8a1fe-a465-4403-8e2c-2170f54b59a0 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.857245] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03a8a1fe-a465-4403-8e2c-2170f54b59a0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.857340] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03a8a1fe-a465-4403-8e2c-2170f54b59a0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.857628] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03a8a1fe-a465-4403-8e2c-2170f54b59a0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.858128] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.858337] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.858440] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.858689] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.858839] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.858993] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03a8a1fe-a465-4403-8e2c-2170f54b59a0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.859246] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-03a8a1fe-a465-4403-8e2c-2170f54b59a0 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.859393] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03a8a1fe-a465-4403-8e2c-2170f54b59a0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.859491] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03a8a1fe-a465-4403-8e2c-2170f54b59a0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.859715] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03a8a1fe-a465-4403-8e2c-2170f54b59a0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.859967] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.860445] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.860555] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.860775] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.860904] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.861049] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03a8a1fe-a465-4403-8e2c-2170f54b59a0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.861192] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('03a8a1fe-a465-4403-8e2c-2170f54b59a0',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.148605] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 56238df1-04a7-4a59-9d0f-ea911fb29f15 in Status: SUCCESS [ 838.148945] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-56238df1-04a7-4a59-9d0f-ea911fb29f15" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.364744] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 03a8a1fe-a465-4403-8e2c-2170f54b59a0: rpc.has_security_group_logging(os_id): False [ 838.383172] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.383413] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.383413] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.383733] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.383733] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.383907] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.384029] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.384144] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.384717] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.384717] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.384717] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.384717] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.384717] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.385065] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.385065] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.385222] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.385222] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.385330] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.385410] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.385485] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.385570] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 03a8a1fe-a465-4403-8e2c-2170f54b59a0 is going to be created. [ 838.451985] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.451985] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.451985] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.451985] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.451985] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.463148] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 03a8a1fe-a465-4403-8e2c-2170f54b59a0 in Status: IN_PROGRESS for 2s [ 840.180028] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 840.180330] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 840.480577] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 03a8a1fe-a465-4403-8e2c-2170f54b59a0 in Status: SUCCESS [ 840.480577] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-03a8a1fe-a465-4403-8e2c-2170f54b59a0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.055184] env[70392]: INFO networking_nsxv3.common.synchronization [req-0611edbf-fd7f-4dda-9f4a-0cc14e59478e req-3b202589-f6a2-4609-bf63-a5bc02da22c1 tempest-FloatingIPsAssociationTestJSON-516556258 tempest-FloatingIPsAssociationTestJSON-516556258-project-member] Enqueued Resource ID: 87729ccf-b5c1-4c71-b616-13269541067e with Priority: HIGHEST for action security_group_members [ 845.055794] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87729ccf-b5c1-4c71-b616-13269541067e with Priority: HIGHEST for action security_group_members [ 845.061032] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-87729ccf-b5c1-4c71-b616-13269541067e taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.061229] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87729ccf-b5c1-4c71-b616-13269541067e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.061305] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87729ccf-b5c1-4c71-b616-13269541067e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.061547] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87729ccf-b5c1-4c71-b616-13269541067e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.061737] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.061868] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.061964] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.062161] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.062288] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.062416] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('87729ccf-b5c1-4c71-b616-13269541067e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.486330] env[70392]: INFO networking_nsxv3.common.synchronization [req-a6b1db44-4cd4-4c17-94bf-dfd63d8e09d6 req-bffb9e99-5f67-4798-a7fd-0e3bdcd54831 tempest-ServerRescueNegativeTestJSON-197938596 tempest-ServerRescueNegativeTestJSON-197938596-project-member] Enqueued Resource ID: eee84844-ea79-48de-9294-c53a759dc328 with Priority: HIGHEST for action security_group_members [ 845.486683] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eee84844-ea79-48de-9294-c53a759dc328 with Priority: HIGHEST for action security_group_members [ 845.487354] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-eee84844-ea79-48de-9294-c53a759dc328 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.487354] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.487354] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.487354] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.489344] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.489344] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.489344] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.489344] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.489344] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.489344] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eee84844-ea79-48de-9294-c53a759dc328',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.565096] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.565096] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.566127] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.566127] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.566127] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.566127] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.566127] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.566127] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.566385] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.566507] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.566617] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 87729ccf-b5c1-4c71-b616-13269541067e is going to be updated. [ 845.605968] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.605968] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.605968] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.605968] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.606208] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.616017] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87729ccf-b5c1-4c71-b616-13269541067e in Status: IN_PROGRESS for 2s [ 845.992487] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eee84844-ea79-48de-9294-c53a759dc328',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.287212] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-553 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.287212] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-553" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.287212] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-553" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.287212] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-553" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.287212] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.287212] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.287212] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.290893] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.291207] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.291469] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 846.291595] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 846.291712] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 846.291825] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 846.291956] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 846.292084] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 846.292231] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 846.314751] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 846.314940] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 846.315175] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 846.315456] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-553" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.315788] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-3d62bb9c-5ad5-4f3f-a264-77e813a370c8 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.315959] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-3d62bb9c-5ad5-4f3f-a264-77e813a370c8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.316093] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-3d62bb9c-5ad5-4f3f-a264-77e813a370c8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.316406] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-3d62bb9c-5ad5-4f3f-a264-77e813a370c8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.319243] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d62bb9c-5ad5-4f3f-a264-77e813a370c8',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.496387] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eee84844-ea79-48de-9294-c53a759dc328',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.825499] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.825784] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.826400] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.826400] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.826520] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.826671] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 3d62bb9c-5ad5-4f3f-a264-77e813a370c8 not found, creating... [ 846.826996] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.827161] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.827312] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.827616] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.827779] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.829050] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.829050] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.829050] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.829219] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.829263] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.829410] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 3d62bb9c-5ad5-4f3f-a264-77e813a370c8 is going to be created. [ 846.864503] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.864726] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.864858] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.865239] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.865560] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.865769] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-3d62bb9c-5ad5-4f3f-a264-77e813a370c8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.000402] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.000402] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.000402] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.000402] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.000402] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.000402] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eee84844-ea79-48de-9294-c53a759dc328 is going to be updated. [ 847.063632] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.063885] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.063935] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.064222] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.064368] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.076777] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eee84844-ea79-48de-9294-c53a759dc328 in Status: IN_PROGRESS for 2s [ 847.627361] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87729ccf-b5c1-4c71-b616-13269541067e in Status: SUCCESS [ 847.627825] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 87729ccf-b5c1-4c71-b616-13269541067e deletion is rescheduled due to dependency. [ 847.627825] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87729ccf-b5c1-4c71-b616-13269541067e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.669107] env[70392]: INFO networking_nsxv3.common.synchronization [req-a6b1db44-4cd4-4c17-94bf-dfd63d8e09d6 req-500377bc-b6fd-4f17-a70c-1ed9c6a0967e service nova] Enqueued Resource ID: eee84844-ea79-48de-9294-c53a759dc328 with Priority: HIGHEST for action security_group_rules [ 847.669316] env[70392]: INFO networking_nsxv3.common.synchronization [req-a6b1db44-4cd4-4c17-94bf-dfd63d8e09d6 req-500377bc-b6fd-4f17-a70c-1ed9c6a0967e service nova] Enqueued Resource ID: eee84844-ea79-48de-9294-c53a759dc328 with Priority: HIGHEST for action security_group_members [ 847.670093] env[70392]: INFO networking_nsxv3.common.synchronization [req-a6b1db44-4cd4-4c17-94bf-dfd63d8e09d6 req-500377bc-b6fd-4f17-a70c-1ed9c6a0967e service nova] Enqueued Resource ID: 3d62bb9c-5ad5-4f3f-a264-77e813a370c8 with Priority: HIGHEST for action port [ 847.670093] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eee84844-ea79-48de-9294-c53a759dc328 with Priority: HIGHEST for action security_group_rules [ 847.670093] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eee84844-ea79-48de-9294-c53a759dc328 with Priority: HIGHEST for action security_group_members [ 847.670093] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d62bb9c-5ad5-4f3f-a264-77e813a370c8 with Priority: HIGHEST for action port [ 847.670823] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eee84844-ea79-48de-9294-c53a759dc328 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.670823] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.670823] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.671034] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.672722] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eee84844-ea79-48de-9294-c53a759dc328',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.673817] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-eee84844-ea79-48de-9294-c53a759dc328 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.673956] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.674774] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-3d62bb9c-5ad5-4f3f-a264-77e813a370c8 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.674774] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3d62bb9c-5ad5-4f3f-a264-77e813a370c8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.674774] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3d62bb9c-5ad5-4f3f-a264-77e813a370c8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.674774] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3d62bb9c-5ad5-4f3f-a264-77e813a370c8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.674774] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d62bb9c-5ad5-4f3f-a264-77e813a370c8',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.178462] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-eee84844-ea79-48de-9294-c53a759dc328 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.178462] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.182610] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3d62bb9c-5ad5-4f3f-a264-77e813a370c8 with status ACTIVE [ 848.182610] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.182839] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.182839] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.182913] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.182999] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.183189] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.183277] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.183334] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.183483] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.183554] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.183726] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.183812] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.183869] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.187019] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.187019] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.187019] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3d62bb9c-5ad5-4f3f-a264-77e813a370c8 is going to be updated. [ 848.210306] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.210498] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.210607] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.210870] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.211048] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.211626] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3d62bb9c-5ad5-4f3f-a264-77e813a370c8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.656496] env[70392]: INFO networking_nsxv3.common.synchronization [req-810fc3e4-9a35-4f68-b38a-c14b879933a3 req-8c8ed8f0-9339-41e8-a9de-7127afc9ca5d tempest-InstanceActionsNegativeTestJSON-314319433 tempest-InstanceActionsNegativeTestJSON-314319433-project-member] Enqueued Resource ID: 12100879-b33a-4e8b-8947-ed54d332f821 with Priority: HIGHEST for action security_group_members [ 848.659356] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12100879-b33a-4e8b-8947-ed54d332f821 with Priority: HIGHEST for action security_group_members [ 848.659356] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-12100879-b33a-4e8b-8947-ed54d332f821 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.659356] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12100879-b33a-4e8b-8947-ed54d332f821" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.659356] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12100879-b33a-4e8b-8947-ed54d332f821" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.659356] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12100879-b33a-4e8b-8947-ed54d332f821" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.659356] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.659356] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.659356] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.659356] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.659356] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.659356] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12100879-b33a-4e8b-8947-ed54d332f821',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.095153] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eee84844-ea79-48de-9294-c53a759dc328 in Status: SUCCESS [ 849.099019] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.099284] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.099638] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.099807] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.099940] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.099984] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.100221] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.100287] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.100419] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eee84844-ea79-48de-9294-c53a759dc328',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.161269] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.161534] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.161624] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.161966] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.162143] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.162442] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.162573] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.162649] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.162880] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.163312] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.163478] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12100879-b33a-4e8b-8947-ed54d332f821 already deleted. [ 849.163634] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12100879-b33a-4e8b-8947-ed54d332f821" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.370907] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-787 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.371222] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-787" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.371345] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-787" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.371771] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-787" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.372368] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.372575] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.372689] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.373211] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.373211] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.373462] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 849.373462] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 849.373589] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 849.373647] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 849.373749] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 849.373840] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 849.373981] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 849.397386] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 849.397386] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 849.397386] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 849.397386] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-787" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.397386] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-6c10b3d7-7462-4e77-8dd9-5098e53f4e11 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.397386] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-6c10b3d7-7462-4e77-8dd9-5098e53f4e11" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.397386] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-6c10b3d7-7462-4e77-8dd9-5098e53f4e11" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.397386] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-6c10b3d7-7462-4e77-8dd9-5098e53f4e11" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.397386] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c10b3d7-7462-4e77-8dd9-5098e53f4e11',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.605019] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eee84844-ea79-48de-9294-c53a759dc328',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.798216] env[70392]: INFO networking_nsxv3.common.synchronization [None req-4db3660c-644f-430b-8215-bf7811eba69f None None] Enqueued Resource ID: d6441280-0aa0-44a8-9fdc-f3a9a706d646 with Priority: HIGHEST for action port [ 849.799153] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6441280-0aa0-44a8-9fdc-f3a9a706d646 with Priority: HIGHEST for action port [ 849.800535] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-d6441280-0aa0-44a8-9fdc-f3a9a706d646 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.800535] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d6441280-0aa0-44a8-9fdc-f3a9a706d646" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.800535] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d6441280-0aa0-44a8-9fdc-f3a9a706d646" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.800535] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d6441280-0aa0-44a8-9fdc-f3a9a706d646" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.800535] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6441280-0aa0-44a8-9fdc-f3a9a706d646',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.900095] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.900912] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.901147] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.901455] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.901638] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.901835] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 6c10b3d7-7462-4e77-8dd9-5098e53f4e11 not found, creating... [ 849.902244] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.902552] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.902647] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.902901] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.904426] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.905540] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.905800] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.905972] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.906395] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.907011] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.907243] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 6c10b3d7-7462-4e77-8dd9-5098e53f4e11 is going to be created. [ 849.954606] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.955246] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.956082] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.956808] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.956808] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.956980] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-6c10b3d7-7462-4e77-8dd9-5098e53f4e11" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.106616] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eee84844-ea79-48de-9294-c53a759dc328',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.303141] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d6441280-0aa0-44a8-9fdc-f3a9a706d646 [ 850.303349] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.303688] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.303688] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.303802] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.303888] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.303984] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d6441280-0aa0-44a8-9fdc-f3a9a706d646 already deleted. [ 850.304088] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d6441280-0aa0-44a8-9fdc-f3a9a706d646" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.609190] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.609190] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.609190] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.609396] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.609598] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.609598] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eee84844-ea79-48de-9294-c53a759dc328 is going to be updated. [ 850.644722] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.644922] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.647181] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.647181] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.647181] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.660196] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eee84844-ea79-48de-9294-c53a759dc328 in Status: IN_PROGRESS for 2s [ 850.860118] env[70392]: INFO networking_nsxv3.common.synchronization [req-810fc3e4-9a35-4f68-b38a-c14b879933a3 req-b886009a-4aa6-4659-8de4-16cf0d3f1a33 service nova] Enqueued Resource ID: 12100879-b33a-4e8b-8947-ed54d332f821 with Priority: HIGHEST for action security_group_rules [ 850.860520] env[70392]: INFO networking_nsxv3.common.synchronization [req-810fc3e4-9a35-4f68-b38a-c14b879933a3 req-b886009a-4aa6-4659-8de4-16cf0d3f1a33 service nova] Enqueued Resource ID: 12100879-b33a-4e8b-8947-ed54d332f821 with Priority: HIGHEST for action security_group_members [ 850.860677] env[70392]: INFO networking_nsxv3.common.synchronization [req-810fc3e4-9a35-4f68-b38a-c14b879933a3 req-b886009a-4aa6-4659-8de4-16cf0d3f1a33 service nova] Enqueued Resource ID: 6c10b3d7-7462-4e77-8dd9-5098e53f4e11 with Priority: HIGHEST for action port [ 850.860952] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12100879-b33a-4e8b-8947-ed54d332f821 with Priority: HIGHEST for action security_group_rules [ 850.861126] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12100879-b33a-4e8b-8947-ed54d332f821 with Priority: HIGHEST for action security_group_members [ 850.861712] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c10b3d7-7462-4e77-8dd9-5098e53f4e11 with Priority: HIGHEST for action port [ 850.862445] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-12100879-b33a-4e8b-8947-ed54d332f821 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.862600] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-12100879-b33a-4e8b-8947-ed54d332f821" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.862676] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-12100879-b33a-4e8b-8947-ed54d332f821" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.862982] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-12100879-b33a-4e8b-8947-ed54d332f821" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.863106] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('12100879-b33a-4e8b-8947-ed54d332f821',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.864186] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-12100879-b33a-4e8b-8947-ed54d332f821 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.864330] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12100879-b33a-4e8b-8947-ed54d332f821" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.864419] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12100879-b33a-4e8b-8947-ed54d332f821" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.864747] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12100879-b33a-4e8b-8947-ed54d332f821" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.864964] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.865226] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.866337] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.866337] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.866506] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.866633] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12100879-b33a-4e8b-8947-ed54d332f821',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.868008] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-6c10b3d7-7462-4e77-8dd9-5098e53f4e11 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.869582] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6c10b3d7-7462-4e77-8dd9-5098e53f4e11" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.869582] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6c10b3d7-7462-4e77-8dd9-5098e53f4e11" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.869582] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6c10b3d7-7462-4e77-8dd9-5098e53f4e11" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.869582] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c10b3d7-7462-4e77-8dd9-5098e53f4e11',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.937557] env[70392]: INFO networking_nsxv3.common.synchronization [req-02f8c97f-c808-41d3-91e8-269974cd1361 req-dd849956-a427-4fd2-8e8a-427fd7cec5ee tempest-ServerActionsTestOtherA-1411478130 tempest-ServerActionsTestOtherA-1411478130-project-member] Enqueued Resource ID: 47a435cb-d815-4f84-b215-41c82faf33b9 with Priority: HIGHEST for action security_group_members [ 850.941922] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47a435cb-d815-4f84-b215-41c82faf33b9 with Priority: HIGHEST for action security_group_members [ 850.946047] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-47a435cb-d815-4f84-b215-41c82faf33b9 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.946047] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.946047] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.946047] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.946047] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.946047] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.946047] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.946047] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.946047] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.946047] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47a435cb-d815-4f84-b215-41c82faf33b9',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.370974] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('12100879-b33a-4e8b-8947-ed54d332f821',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.372396] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-12100879-b33a-4e8b-8947-ed54d332f821 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.372396] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12100879-b33a-4e8b-8947-ed54d332f821" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.372521] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6c10b3d7-7462-4e77-8dd9-5098e53f4e11 with status ACTIVE [ 851.372719] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.372812] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.372864] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.373049] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.373167] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.373326] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.373443] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.373757] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.373789] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.373899] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.374202] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.374356] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.374456] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.374679] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.374941] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.374973] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6c10b3d7-7462-4e77-8dd9-5098e53f4e11 is going to be updated. [ 851.406109] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.406330] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.406392] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.406678] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.406838] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.407027] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6c10b3d7-7462-4e77-8dd9-5098e53f4e11" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.450197] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.450402] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.450470] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.450721] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.450828] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.452254] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.452254] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.452254] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.452254] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.452254] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.452254] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47a435cb-d815-4f84-b215-41c82faf33b9 already deleted. [ 851.452254] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.558449] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-844 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.558449] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-844" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.558689] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-844" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.558918] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-844" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.559464] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.559651] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.559773] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.560111] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.560318] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.560545] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 851.560661] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 851.560780] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 851.560917] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 851.561105] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 851.561256] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 851.561407] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 851.588453] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 851.588617] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 851.588754] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 851.588937] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-844" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.589306] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-efaf7834-af3a-4df7-b21b-db777b534d75 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.589528] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-efaf7834-af3a-4df7-b21b-db777b534d75" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.589612] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-efaf7834-af3a-4df7-b21b-db777b534d75" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.589951] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-efaf7834-af3a-4df7-b21b-db777b534d75" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.590523] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('efaf7834-af3a-4df7-b21b-db777b534d75',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.877990] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('12100879-b33a-4e8b-8947-ed54d332f821',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.922257] env[70392]: INFO networking_nsxv3.common.synchronization [req-bd741802-8627-44a6-8190-47c9cbe6d91e req-82cac305-b28c-45ef-a7d5-6c435c13647f tempest-AttachInterfacesTestJSON-2046649887 tempest-AttachInterfacesTestJSON-2046649887-project-member] Enqueued Resource ID: 3507e503-4abd-47ec-8347-82fc9e691881 with Priority: HIGHEST for action security_group_members [ 851.922837] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3507e503-4abd-47ec-8347-82fc9e691881 with Priority: HIGHEST for action security_group_members [ 851.923177] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-3507e503-4abd-47ec-8347-82fc9e691881 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.923292] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.923409] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.923666] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.923818] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.923913] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.923972] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.924132] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.924217] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.924307] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3507e503-4abd-47ec-8347-82fc9e691881',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.966039] env[70392]: INFO networking_nsxv3.common.synchronization [None req-15ad8665-574f-48af-9584-5b9ce0be2410 None None] Enqueued Resource ID: 4aba26b5-a288-4402-b674-25be7bca1c98 with Priority: HIGHEST for action port [ 851.966424] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4aba26b5-a288-4402-b674-25be7bca1c98 with Priority: HIGHEST for action port [ 851.967071] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-4aba26b5-a288-4402-b674-25be7bca1c98 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.967221] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4aba26b5-a288-4402-b674-25be7bca1c98" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.967273] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4aba26b5-a288-4402-b674-25be7bca1c98" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.967532] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4aba26b5-a288-4402-b674-25be7bca1c98" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.967614] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4aba26b5-a288-4402-b674-25be7bca1c98',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.096652] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.097043] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.097043] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.097446] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.097778] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.097863] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port efaf7834-af3a-4df7-b21b-db777b534d75 not found, creating... [ 852.098104] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.098300] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.098439] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.098665] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.099540] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.099540] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.099540] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.099704] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.099826] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.100112] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.101594] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: efaf7834-af3a-4df7-b21b-db777b534d75 is going to be created. [ 852.126931] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.127282] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.127422] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.127703] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.128430] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.128769] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-efaf7834-af3a-4df7-b21b-db777b534d75" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.381638] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.381873] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.381956] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.382180] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.382323] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.382455] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12100879-b33a-4e8b-8947-ed54d332f821 is going to be created. [ 852.419993] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.420270] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.420325] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.420554] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.420711] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.426448] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.426615] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.426710] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.426900] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.426994] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.427222] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.427325] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.427382] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.427560] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.427640] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.427739] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3507e503-4abd-47ec-8347-82fc9e691881 already deleted. [ 852.427871] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.433350] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12100879-b33a-4e8b-8947-ed54d332f821 in Status: UNINITIALIZED for 2s [ 852.474029] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4aba26b5-a288-4402-b674-25be7bca1c98 [ 852.474029] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.474029] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.474029] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.474674] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.474674] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.474674] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4aba26b5-a288-4402-b674-25be7bca1c98 already deleted. [ 852.474674] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4aba26b5-a288-4402-b674-25be7bca1c98" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.675251] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eee84844-ea79-48de-9294-c53a759dc328 in Status: SUCCESS [ 852.675251] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.675251] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.675251] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.675251] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.675251] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.675251] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.675251] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.675251] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.675251] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.675251] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eee84844-ea79-48de-9294-c53a759dc328',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.859291] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-328 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.859491] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.859616] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.859885] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.860192] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.860361] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.860480] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.860704] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.860854] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.862210] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 852.862367] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 852.862722] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 852.862868] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 852.862992] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 852.863230] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 852.863454] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 852.883888] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 852.884214] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 852.884424] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 852.884424] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.884858] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-5b032908-3c2b-4719-b6ec-0bf9a17d20ca taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.884920] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-5b032908-3c2b-4719-b6ec-0bf9a17d20ca" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.885063] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-5b032908-3c2b-4719-b6ec-0bf9a17d20ca" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.885405] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-5b032908-3c2b-4719-b6ec-0bf9a17d20ca" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.885547] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b032908-3c2b-4719-b6ec-0bf9a17d20ca',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.888928] env[70392]: INFO networking_nsxv3.common.synchronization [req-02f8c97f-c808-41d3-91e8-269974cd1361 req-0a7980d8-4857-419d-ab15-ea1381e11cf5 service nova] Enqueued Resource ID: 47a435cb-d815-4f84-b215-41c82faf33b9 with Priority: HIGHEST for action security_group_rules [ 852.889225] env[70392]: INFO networking_nsxv3.common.synchronization [req-02f8c97f-c808-41d3-91e8-269974cd1361 req-0a7980d8-4857-419d-ab15-ea1381e11cf5 service nova] Enqueued Resource ID: 47a435cb-d815-4f84-b215-41c82faf33b9 with Priority: HIGHEST for action security_group_members [ 852.889362] env[70392]: INFO networking_nsxv3.common.synchronization [req-02f8c97f-c808-41d3-91e8-269974cd1361 req-0a7980d8-4857-419d-ab15-ea1381e11cf5 service nova] Enqueued Resource ID: efaf7834-af3a-4df7-b21b-db777b534d75 with Priority: HIGHEST for action port [ 852.889821] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47a435cb-d815-4f84-b215-41c82faf33b9 with Priority: HIGHEST for action security_group_rules [ 852.890022] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47a435cb-d815-4f84-b215-41c82faf33b9 with Priority: HIGHEST for action security_group_members [ 852.890211] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efaf7834-af3a-4df7-b21b-db777b534d75 with Priority: HIGHEST for action port [ 852.890811] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-47a435cb-d815-4f84-b215-41c82faf33b9 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.890982] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.891091] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.891342] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.891469] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('47a435cb-d815-4f84-b215-41c82faf33b9',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.892384] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-47a435cb-d815-4f84-b215-41c82faf33b9 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.892613] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.892765] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.892990] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.893190] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.893315] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.893422] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.893600] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.893708] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.893817] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47a435cb-d815-4f84-b215-41c82faf33b9',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.894595] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-efaf7834-af3a-4df7-b21b-db777b534d75 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.894720] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-efaf7834-af3a-4df7-b21b-db777b534d75" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.894778] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-efaf7834-af3a-4df7-b21b-db777b534d75" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.894916] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-efaf7834-af3a-4df7-b21b-db777b534d75" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.894984] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('efaf7834-af3a-4df7-b21b-db777b534d75',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.177357] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-eee84844-ea79-48de-9294-c53a759dc328 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.177357] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.177357] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.177597] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.177712] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.177802] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.177867] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.178035] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.178153] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.178250] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.178406] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-eee84844-ea79-48de-9294-c53a759dc328 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.178509] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.178545] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.178884] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.178942] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.179085] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.179167] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.179594] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.179594] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.179594] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.179594] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eee84844-ea79-48de-9294-c53a759dc328',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.390843] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.391112] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.391232] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.391526] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.391687] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.391870] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 5b032908-3c2b-4719-b6ec-0bf9a17d20ca not found, creating... [ 853.392192] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.392358] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.392516] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.392778] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.392929] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.393270] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.393434] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.393575] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.393795] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.393950] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.394125] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 5b032908-3c2b-4719-b6ec-0bf9a17d20ca is going to be created. [ 853.400024] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-47a435cb-d815-4f84-b215-41c82faf33b9 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.400024] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.400024] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('47a435cb-d815-4f84-b215-41c82faf33b9',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.400024] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port efaf7834-af3a-4df7-b21b-db777b534d75 with status ACTIVE [ 853.400024] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.400024] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.400024] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.400024] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.400024] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.400613] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.400613] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.400613] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.400613] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.400613] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.401571] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.401571] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.401571] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.401571] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.401571] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.401571] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: efaf7834-af3a-4df7-b21b-db777b534d75 is going to be updated. [ 853.423618] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.423992] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.424249] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.424673] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.425461] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.425461] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-5b032908-3c2b-4719-b6ec-0bf9a17d20ca" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.435177] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.435385] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.435498] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.435782] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.436000] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.436276] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-efaf7834-af3a-4df7-b21b-db777b534d75" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.676727] env[70392]: INFO networking_nsxv3.common.synchronization [req-89184447-75da-4ad5-ad97-f0c5c56c2134 req-b8f25a5e-d5c2-40ef-9b3f-16a7b64a6568 tempest-AttachInterfacesUnderV243Test-202360309 tempest-AttachInterfacesUnderV243Test-202360309-project-member] Enqueued Resource ID: 12c8b5a9-023e-43d6-a4a6-03004d0ac434 with Priority: HIGHEST for action security_group_members [ 853.677310] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12c8b5a9-023e-43d6-a4a6-03004d0ac434 with Priority: HIGHEST for action security_group_members [ 853.677616] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-12c8b5a9-023e-43d6-a4a6-03004d0ac434 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.677746] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12c8b5a9-023e-43d6-a4a6-03004d0ac434" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.677817] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12c8b5a9-023e-43d6-a4a6-03004d0ac434" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.678581] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12c8b5a9-023e-43d6-a4a6-03004d0ac434" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.678768] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.678881] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.678938] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.679713] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.679713] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.679713] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12c8b5a9-023e-43d6-a4a6-03004d0ac434',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.681865] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eee84844-ea79-48de-9294-c53a759dc328: rpc.has_security_group_logging(os_id): False [ 853.714409] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.714705] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.714790] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.715070] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.715070] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.715304] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.715426] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.715562] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.715624] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.715709] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.715895] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.715997] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.716108] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.716258] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.716339] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.716612] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.716612] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.716736] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.716825] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.716876] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.716956] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eee84844-ea79-48de-9294-c53a759dc328 is going to be updated. [ 853.800554] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.800707] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.800814] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.800980] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.801226] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.818960] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eee84844-ea79-48de-9294-c53a759dc328 in Status: IN_PROGRESS for 2s [ 853.904418] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('47a435cb-d815-4f84-b215-41c82faf33b9',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.182041] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.182242] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.182340] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.182667] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.182768] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.182986] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.183099] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.183157] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.183369] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.183457] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.183547] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12c8b5a9-023e-43d6-a4a6-03004d0ac434 already deleted. [ 854.183630] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12c8b5a9-023e-43d6-a4a6-03004d0ac434" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.288165] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-913 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.288165] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-913" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.288165] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-913" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.288165] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-913" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.288165] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.288165] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.288165] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.288478] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.289029] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.289029] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 854.289029] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 854.289029] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 854.289251] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 854.289251] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 854.289310] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 854.289430] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 854.315186] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 854.315382] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 854.315523] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 854.315708] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-913" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.316057] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-e6f94ef5-68db-4e62-a469-d1c64f677e29 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.316357] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-e6f94ef5-68db-4e62-a469-d1c64f677e29" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.316487] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-e6f94ef5-68db-4e62-a469-d1c64f677e29" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.316802] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-e6f94ef5-68db-4e62-a469-d1c64f677e29" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.316944] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e6f94ef5-68db-4e62-a469-d1c64f677e29',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.370791] env[70392]: INFO networking_nsxv3.common.synchronization [req-bd741802-8627-44a6-8190-47c9cbe6d91e req-de85e944-082b-4958-bd9d-8474658f94db service nova] Enqueued Resource ID: 3507e503-4abd-47ec-8347-82fc9e691881 with Priority: HIGHEST for action security_group_rules [ 854.370920] env[70392]: INFO networking_nsxv3.common.synchronization [req-bd741802-8627-44a6-8190-47c9cbe6d91e req-de85e944-082b-4958-bd9d-8474658f94db service nova] Enqueued Resource ID: 3507e503-4abd-47ec-8347-82fc9e691881 with Priority: HIGHEST for action security_group_members [ 854.371076] env[70392]: INFO networking_nsxv3.common.synchronization [req-bd741802-8627-44a6-8190-47c9cbe6d91e req-de85e944-082b-4958-bd9d-8474658f94db service nova] Enqueued Resource ID: 5b032908-3c2b-4719-b6ec-0bf9a17d20ca with Priority: HIGHEST for action port [ 854.371666] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3507e503-4abd-47ec-8347-82fc9e691881 with Priority: HIGHEST for action security_group_rules [ 854.371757] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3507e503-4abd-47ec-8347-82fc9e691881 with Priority: HIGHEST for action security_group_members [ 854.371848] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b032908-3c2b-4719-b6ec-0bf9a17d20ca with Priority: HIGHEST for action port [ 854.372195] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3507e503-4abd-47ec-8347-82fc9e691881 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.372272] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.372337] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.372589] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.372661] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3507e503-4abd-47ec-8347-82fc9e691881',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.373532] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-3507e503-4abd-47ec-8347-82fc9e691881 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.373638] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.373710] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.373885] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.374039] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.374135] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.374199] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.374338] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.374424] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.374514] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3507e503-4abd-47ec-8347-82fc9e691881',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.375273] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-5b032908-3c2b-4719-b6ec-0bf9a17d20ca taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.375593] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5b032908-3c2b-4719-b6ec-0bf9a17d20ca" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.375593] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5b032908-3c2b-4719-b6ec-0bf9a17d20ca" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.375593] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5b032908-3c2b-4719-b6ec-0bf9a17d20ca" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.375730] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b032908-3c2b-4719-b6ec-0bf9a17d20ca',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.408246] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.408411] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.408481] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.409097] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.409097] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.409097] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47a435cb-d815-4f84-b215-41c82faf33b9 is going to be created. [ 854.440154] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.440305] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.440406] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.440633] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.440826] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.444514] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12100879-b33a-4e8b-8947-ed54d332f821 in Status: SUCCESS [ 854.444692] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12100879-b33a-4e8b-8947-ed54d332f821" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.444692] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12100879-b33a-4e8b-8947-ed54d332f821" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.444914] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12100879-b33a-4e8b-8947-ed54d332f821" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.445146] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.445264] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.445332] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.445520] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.445607] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.445693] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12100879-b33a-4e8b-8947-ed54d332f821" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.445783] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('12100879-b33a-4e8b-8947-ed54d332f821',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.451705] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47a435cb-d815-4f84-b215-41c82faf33b9 in Status: UNINITIALIZED for 2s [ 854.820313] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.820577] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.820709] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.820991] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.821288] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.821373] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port e6f94ef5-68db-4e62-a469-d1c64f677e29 not found, creating... [ 854.821647] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.821806] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.821923] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.822170] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.822315] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.822596] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.822749] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.822866] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.823085] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.823224] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.823368] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: e6f94ef5-68db-4e62-a469-d1c64f677e29 is going to be created. [ 854.881301] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.881516] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.881644] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.881916] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.882160] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.882389] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-e6f94ef5-68db-4e62-a469-d1c64f677e29" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.883272] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3507e503-4abd-47ec-8347-82fc9e691881',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.884487] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-3507e503-4abd-47ec-8347-82fc9e691881 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.884577] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.884761] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5b032908-3c2b-4719-b6ec-0bf9a17d20ca with status ACTIVE [ 854.884943] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.885065] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.885204] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.885401] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.885451] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.885621] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.885771] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.885771] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.885911] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.886023] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.886158] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.886259] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.886319] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.886522] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.886696] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.886765] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5b032908-3c2b-4719-b6ec-0bf9a17d20ca is going to be updated. [ 854.923555] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.923964] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.923964] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.924155] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.924353] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.924675] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5b032908-3c2b-4719-b6ec-0bf9a17d20ca" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.947888] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-12100879-b33a-4e8b-8947-ed54d332f821 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.948149] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12100879-b33a-4e8b-8947-ed54d332f821" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.948214] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12100879-b33a-4e8b-8947-ed54d332f821" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.948440] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12100879-b33a-4e8b-8947-ed54d332f821" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.948796] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.948905] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.948971] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.949163] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.949257] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.949350] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12100879-b33a-4e8b-8947-ed54d332f821" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.949503] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-12100879-b33a-4e8b-8947-ed54d332f821 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.949598] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12100879-b33a-4e8b-8947-ed54d332f821" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.949659] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12100879-b33a-4e8b-8947-ed54d332f821" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.949811] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12100879-b33a-4e8b-8947-ed54d332f821" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.949950] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.950049] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.950190] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.950318] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.950403] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.950509] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12100879-b33a-4e8b-8947-ed54d332f821" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.950636] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('12100879-b33a-4e8b-8947-ed54d332f821',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.389424] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3507e503-4abd-47ec-8347-82fc9e691881',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.453325] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 12100879-b33a-4e8b-8947-ed54d332f821: rpc.has_security_group_logging(os_id): False [ 855.479304] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.479783] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.479783] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.479902] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.480095] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.480420] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.480525] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.480721] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.480878] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.480960] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.485300] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.485431] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.486390] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.486390] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.486390] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.486390] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.486390] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.486390] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.486390] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.486977] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.486977] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 12100879-b33a-4e8b-8947-ed54d332f821 is going to be created. [ 855.574836] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.575804] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.575804] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.577444] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.577491] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.597112] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 12100879-b33a-4e8b-8947-ed54d332f821 in Status: IN_PROGRESS for 2s [ 855.626887] env[70392]: INFO networking_nsxv3.common.synchronization [req-89184447-75da-4ad5-ad97-f0c5c56c2134 req-20d12ab7-c682-4399-9701-2253fb3b0fa3 service nova] Enqueued Resource ID: 12c8b5a9-023e-43d6-a4a6-03004d0ac434 with Priority: HIGHEST for action security_group_rules [ 855.626887] env[70392]: INFO networking_nsxv3.common.synchronization [req-89184447-75da-4ad5-ad97-f0c5c56c2134 req-20d12ab7-c682-4399-9701-2253fb3b0fa3 service nova] Enqueued Resource ID: 12c8b5a9-023e-43d6-a4a6-03004d0ac434 with Priority: HIGHEST for action security_group_members [ 855.626887] env[70392]: INFO networking_nsxv3.common.synchronization [req-89184447-75da-4ad5-ad97-f0c5c56c2134 req-20d12ab7-c682-4399-9701-2253fb3b0fa3 service nova] Enqueued Resource ID: e6f94ef5-68db-4e62-a469-d1c64f677e29 with Priority: HIGHEST for action port [ 855.626887] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12c8b5a9-023e-43d6-a4a6-03004d0ac434 with Priority: HIGHEST for action security_group_rules [ 855.626887] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12c8b5a9-023e-43d6-a4a6-03004d0ac434 with Priority: HIGHEST for action security_group_members [ 855.626887] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6f94ef5-68db-4e62-a469-d1c64f677e29 with Priority: HIGHEST for action port [ 855.627714] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-12c8b5a9-023e-43d6-a4a6-03004d0ac434 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.627905] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-12c8b5a9-023e-43d6-a4a6-03004d0ac434" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.627972] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-12c8b5a9-023e-43d6-a4a6-03004d0ac434" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.628317] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-12c8b5a9-023e-43d6-a4a6-03004d0ac434" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.628419] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('12c8b5a9-023e-43d6-a4a6-03004d0ac434',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.629879] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-12c8b5a9-023e-43d6-a4a6-03004d0ac434 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.630013] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12c8b5a9-023e-43d6-a4a6-03004d0ac434" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.630209] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12c8b5a9-023e-43d6-a4a6-03004d0ac434" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.630421] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12c8b5a9-023e-43d6-a4a6-03004d0ac434" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.630594] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.630686] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.630981] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.631329] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.631329] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.631419] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12c8b5a9-023e-43d6-a4a6-03004d0ac434',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.632453] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-e6f94ef5-68db-4e62-a469-d1c64f677e29 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.632578] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e6f94ef5-68db-4e62-a469-d1c64f677e29" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.632653] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e6f94ef5-68db-4e62-a469-d1c64f677e29" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.632845] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e6f94ef5-68db-4e62-a469-d1c64f677e29" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.633045] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e6f94ef5-68db-4e62-a469-d1c64f677e29',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.836274] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eee84844-ea79-48de-9294-c53a759dc328 in Status: SUCCESS [ 855.836643] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.896810] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.897138] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.897217] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.897440] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.897533] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.897635] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3507e503-4abd-47ec-8347-82fc9e691881 is going to be created. [ 855.922543] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.924790] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.924790] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.924790] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.924790] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.934356] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3507e503-4abd-47ec-8347-82fc9e691881 in Status: UNINITIALIZED for 2s [ 856.135305] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('12c8b5a9-023e-43d6-a4a6-03004d0ac434',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.136677] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-12c8b5a9-023e-43d6-a4a6-03004d0ac434 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.136877] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12c8b5a9-023e-43d6-a4a6-03004d0ac434" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.137075] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e6f94ef5-68db-4e62-a469-d1c64f677e29 with status ACTIVE [ 856.137348] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.137633] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.137633] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.139101] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.139101] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.139101] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.139101] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.139101] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.139101] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.139101] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.139101] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.139101] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.139101] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.139101] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.139654] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.139654] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e6f94ef5-68db-4e62-a469-d1c64f677e29 is going to be updated. [ 856.185159] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.185848] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.185848] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.185848] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.186016] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.186167] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e6f94ef5-68db-4e62-a469-d1c64f677e29" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.462670] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47a435cb-d815-4f84-b215-41c82faf33b9 in Status: SUCCESS [ 856.462670] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.462670] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.462670] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.462909] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.462909] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.463000] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.464356] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.464356] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.464356] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.464356] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('47a435cb-d815-4f84-b215-41c82faf33b9',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.466267] env[70392]: INFO networking_nsxv3.common.synchronization [req-f1d37069-16e6-44aa-9536-4976ca491b62 req-3d35b49d-c31e-45e3-8416-0112015a9b22 tempest-ImagesTestJSON-499820929 tempest-ImagesTestJSON-499820929-project-member] Enqueued Resource ID: bca01ddc-73d5-4856-bbff-aefad642492a with Priority: HIGHEST for action security_group_members [ 856.467024] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bca01ddc-73d5-4856-bbff-aefad642492a with Priority: HIGHEST for action security_group_members [ 856.467266] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-bca01ddc-73d5-4856-bbff-aefad642492a taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.467332] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.467332] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.467569] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.467721] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.467815] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.467878] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.471823] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.471972] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.472489] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bca01ddc-73d5-4856-bbff-aefad642492a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.642163] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('12c8b5a9-023e-43d6-a4a6-03004d0ac434',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.967994] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('47a435cb-d815-4f84-b215-41c82faf33b9',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.975770] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.977039] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.977039] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.977039] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.977039] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.977039] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.977039] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.977039] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.977039] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.977039] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.978376] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bca01ddc-73d5-4856-bbff-aefad642492a already deleted. [ 856.978376] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.102369] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-153 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.102567] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-153" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.102657] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-153" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.103015] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-153" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.103677] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.104108] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.104410] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.104817] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.105537] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.105537] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 857.105537] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 857.105717] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 857.106437] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 857.106437] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 857.106437] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 857.106437] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 857.138051] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 857.138051] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 857.138676] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 857.138676] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-153" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.138890] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-38b7d682-eac4-418c-bf38-110891cd01c6 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.139112] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-38b7d682-eac4-418c-bf38-110891cd01c6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.139192] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-38b7d682-eac4-418c-bf38-110891cd01c6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.139656] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-38b7d682-eac4-418c-bf38-110891cd01c6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.139827] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38b7d682-eac4-418c-bf38-110891cd01c6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.145971] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.149585] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.149585] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.149585] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.149585] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.149585] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12c8b5a9-023e-43d6-a4a6-03004d0ac434 is going to be created. [ 857.181764] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.181764] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.182236] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.182236] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.183046] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.196233] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12c8b5a9-023e-43d6-a4a6-03004d0ac434 in Status: UNINITIALIZED for 2s [ 857.290958] env[70392]: INFO networking_nsxv3.common.synchronization [req-f8695753-6e5a-41cc-83aa-8ddcdd88022a req-938e2f42-2ebf-462e-bba4-ff5b13a7e5c0 tempest-ServersTestJSON-998170705 tempest-ServersTestJSON-998170705-project-member] Enqueued Resource ID: e91c56eb-c593-402a-8bcc-78c2b86ccae6 with Priority: HIGHEST for action security_group_members [ 857.290958] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e91c56eb-c593-402a-8bcc-78c2b86ccae6 with Priority: HIGHEST for action security_group_members [ 857.291812] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-e91c56eb-c593-402a-8bcc-78c2b86ccae6 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.292973] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e91c56eb-c593-402a-8bcc-78c2b86ccae6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.292973] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e91c56eb-c593-402a-8bcc-78c2b86ccae6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.292973] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e91c56eb-c593-402a-8bcc-78c2b86ccae6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.292973] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.294550] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.294550] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.294550] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.294550] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.294550] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e91c56eb-c593-402a-8bcc-78c2b86ccae6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.471539] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 47a435cb-d815-4f84-b215-41c82faf33b9: rpc.has_security_group_logging(os_id): False [ 857.493796] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.493796] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.493796] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.494917] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.494917] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.494917] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.494917] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.494917] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.494917] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.494917] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.494917] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 47a435cb-d815-4f84-b215-41c82faf33b9 is going to be created. [ 857.573235] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.573403] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.573441] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.573648] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.573822] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.587409] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 47a435cb-d815-4f84-b215-41c82faf33b9 in Status: IN_PROGRESS for 2s [ 857.612398] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 12100879-b33a-4e8b-8947-ed54d332f821 in Status: SUCCESS [ 857.612734] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-12100879-b33a-4e8b-8947-ed54d332f821" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.643130] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.643404] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.643540] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.643818] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.644065] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.644181] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 38b7d682-eac4-418c-bf38-110891cd01c6 not found, creating... [ 857.644392] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.644556] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.644691] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.645333] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.645504] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.645866] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.645955] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.646078] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.646295] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.646436] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.646607] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 38b7d682-eac4-418c-bf38-110891cd01c6 is going to be created. [ 857.697826] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.697826] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.697826] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.697826] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.697826] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.697826] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-38b7d682-eac4-418c-bf38-110891cd01c6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.795993] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.796152] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.796152] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.796400] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.796667] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.797056] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.797500] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.797500] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.797604] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.798185] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.798185] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e91c56eb-c593-402a-8bcc-78c2b86ccae6 is going to be updated. [ 857.847834] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.848083] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.848083] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.848282] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.848430] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.857433] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e91c56eb-c593-402a-8bcc-78c2b86ccae6 in Status: IN_PROGRESS for 2s [ 857.944064] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3507e503-4abd-47ec-8347-82fc9e691881 in Status: SUCCESS [ 857.944292] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.944470] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.944679] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.944918] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.945044] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.945044] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.945203] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.945284] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.945367] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.945462] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3507e503-4abd-47ec-8347-82fc9e691881',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.453697] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-3507e503-4abd-47ec-8347-82fc9e691881 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.454135] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.454135] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.454553] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.454843] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.455028] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.455133] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.455390] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.455510] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.455639] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.455851] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-3507e503-4abd-47ec-8347-82fc9e691881 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.455995] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.461148] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.461311] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.461482] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.461801] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.461801] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.461971] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.462034] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.462162] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.462162] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3507e503-4abd-47ec-8347-82fc9e691881',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.557798] env[70392]: INFO networking_nsxv3.common.synchronization [req-f1d37069-16e6-44aa-9536-4976ca491b62 req-a59cddc7-7329-4064-a1c9-bd631b58b2c7 service nova] Enqueued Resource ID: bca01ddc-73d5-4856-bbff-aefad642492a with Priority: HIGHEST for action security_group_rules [ 858.558129] env[70392]: INFO networking_nsxv3.common.synchronization [req-f1d37069-16e6-44aa-9536-4976ca491b62 req-a59cddc7-7329-4064-a1c9-bd631b58b2c7 service nova] Enqueued Resource ID: bca01ddc-73d5-4856-bbff-aefad642492a with Priority: HIGHEST for action security_group_members [ 858.558264] env[70392]: INFO networking_nsxv3.common.synchronization [req-f1d37069-16e6-44aa-9536-4976ca491b62 req-a59cddc7-7329-4064-a1c9-bd631b58b2c7 service nova] Enqueued Resource ID: 38b7d682-eac4-418c-bf38-110891cd01c6 with Priority: HIGHEST for action port [ 858.558514] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bca01ddc-73d5-4856-bbff-aefad642492a with Priority: HIGHEST for action security_group_rules [ 858.559267] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bca01ddc-73d5-4856-bbff-aefad642492a with Priority: HIGHEST for action security_group_members [ 858.559267] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38b7d682-eac4-418c-bf38-110891cd01c6 with Priority: HIGHEST for action port [ 858.565243] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bca01ddc-73d5-4856-bbff-aefad642492a taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.565243] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.565243] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.565243] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.565243] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bca01ddc-73d5-4856-bbff-aefad642492a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.565243] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-bca01ddc-73d5-4856-bbff-aefad642492a taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.565243] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.565243] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.565243] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.565243] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.565243] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.565243] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.565243] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.565243] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.565243] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bca01ddc-73d5-4856-bbff-aefad642492a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.565243] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-38b7d682-eac4-418c-bf38-110891cd01c6 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.565243] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-38b7d682-eac4-418c-bf38-110891cd01c6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.565243] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-38b7d682-eac4-418c-bf38-110891cd01c6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.565985] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-38b7d682-eac4-418c-bf38-110891cd01c6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.570663] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38b7d682-eac4-418c-bf38-110891cd01c6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.965942] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3507e503-4abd-47ec-8347-82fc9e691881: rpc.has_security_group_logging(os_id): False [ 858.999990] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.000165] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.000266] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.000515] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.000610] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.000824] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.000924] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.001017] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.001176] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.001254] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.001441] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.001519] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.001581] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.001725] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.001796] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.002143] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.002315] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.002384] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.002537] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.002651] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.002693] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3507e503-4abd-47ec-8347-82fc9e691881 is going to be created. [ 859.073214] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-bca01ddc-73d5-4856-bbff-aefad642492a taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.073412] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.073654] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bca01ddc-73d5-4856-bbff-aefad642492a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.074851] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 38b7d682-eac4-418c-bf38-110891cd01c6 with status ACTIVE [ 859.074940] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.075009] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.075122] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.075367] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.075432] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.075656] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.075768] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.075835] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.076013] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.080447] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.080797] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.080962] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.081094] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.081370] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.081993] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.082154] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 38b7d682-eac4-418c-bf38-110891cd01c6 is going to be updated. [ 859.105970] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.106316] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.106576] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.106870] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.107095] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.137261] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.137617] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.137617] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.138065] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.138296] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.138536] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-38b7d682-eac4-418c-bf38-110891cd01c6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.140261] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3507e503-4abd-47ec-8347-82fc9e691881 in Status: IN_PROGRESS for 2s [ 859.218512] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12c8b5a9-023e-43d6-a4a6-03004d0ac434 in Status: SUCCESS [ 859.218904] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12c8b5a9-023e-43d6-a4a6-03004d0ac434" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.219204] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12c8b5a9-023e-43d6-a4a6-03004d0ac434" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.219524] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12c8b5a9-023e-43d6-a4a6-03004d0ac434" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.220255] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.220255] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.220255] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.220537] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.220845] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.220845] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12c8b5a9-023e-43d6-a4a6-03004d0ac434" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.220845] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('12c8b5a9-023e-43d6-a4a6-03004d0ac434',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.419478] env[70392]: INFO networking_nsxv3.common.synchronization [None req-bc9f806f-8f97-42d0-95f2-6a8202e6ffbf None None] Enqueued Resource ID: 328a2882-dfdb-430e-a0c6-ee2b6b8cb68f with Priority: HIGHEST for action port [ 859.419995] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 328a2882-dfdb-430e-a0c6-ee2b6b8cb68f with Priority: HIGHEST for action port [ 859.420392] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-328a2882-dfdb-430e-a0c6-ee2b6b8cb68f taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.420566] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-328a2882-dfdb-430e-a0c6-ee2b6b8cb68f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.420566] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-328a2882-dfdb-430e-a0c6-ee2b6b8cb68f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.420824] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-328a2882-dfdb-430e-a0c6-ee2b6b8cb68f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.420905] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('328a2882-dfdb-430e-a0c6-ee2b6b8cb68f',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.480612] env[70392]: INFO networking_nsxv3.common.synchronization [req-52eb2618-fdf7-42fd-95a5-95452ac3c2f7 req-103b44bf-4230-493b-98c7-e5db6bde3936 tempest-ServerDiskConfigTestJSON-277542510 tempest-ServerDiskConfigTestJSON-277542510-project-member] Enqueued Resource ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 with Priority: HIGHEST for action security_group_members [ 859.481682] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 with Priority: HIGHEST for action security_group_members [ 859.482533] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60d7eaa-9583-4c75-97fa-4049c63576b6 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.482533] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.482533] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.483124] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.483333] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.483485] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.483576] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.484158] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.484158] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.484158] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b60d7eaa-9583-4c75-97fa-4049c63576b6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.591023] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bca01ddc-73d5-4856-bbff-aefad642492a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.607895] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 47a435cb-d815-4f84-b215-41c82faf33b9 in Status: SUCCESS [ 859.608150] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.728814] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('12c8b5a9-023e-43d6-a4a6-03004d0ac434',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.875664] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e91c56eb-c593-402a-8bcc-78c2b86ccae6 in Status: SUCCESS [ 859.875664] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e91c56eb-c593-402a-8bcc-78c2b86ccae6 deletion is rescheduled due to dependency. [ 859.875664] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e91c56eb-c593-402a-8bcc-78c2b86ccae6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.923336] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 328a2882-dfdb-430e-a0c6-ee2b6b8cb68f [ 859.923619] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.923756] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.923826] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.924059] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.924155] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.924255] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:328a2882-dfdb-430e-a0c6-ee2b6b8cb68f already deleted. [ 859.924356] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-328a2882-dfdb-430e-a0c6-ee2b6b8cb68f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.989303] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.989303] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.989303] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.989303] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.989303] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.989303] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.989303] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.989303] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.989303] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.989303] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.989303] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 is going to be updated. [ 860.038198] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.038198] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.038198] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.038390] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.038548] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.050445] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 in Status: IN_PROGRESS for 2s [ 860.097025] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.097025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.097025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.097025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.097025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.097025] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bca01ddc-73d5-4856-bbff-aefad642492a is going to be created. [ 860.124152] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.124310] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.124385] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.124614] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.125019] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.141022] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bca01ddc-73d5-4856-bbff-aefad642492a in Status: UNINITIALIZED for 2s [ 860.230550] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 12c8b5a9-023e-43d6-a4a6-03004d0ac434: rpc.has_security_group_logging(os_id): False [ 860.255390] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.255608] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.255701] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.255956] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.256096] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.256367] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.256677] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.256677] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.256839] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.256839] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.256913] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 12c8b5a9-023e-43d6-a4a6-03004d0ac434 is going to be created. [ 860.354175] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.354307] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.354387] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.354592] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.354771] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.366237] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 12c8b5a9-023e-43d6-a4a6-03004d0ac434 in Status: IN_PROGRESS for 2s [ 861.090805] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-256 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.093028] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-256" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.093028] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-256" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.093028] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-256" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.093028] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.093028] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.093708] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.094229] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.094538] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.094934] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 861.097633] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 861.097633] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 861.097633] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 861.097633] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 861.097633] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 861.097633] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 861.118299] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 861.118484] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 861.118605] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 861.118861] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-256" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.120033] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-3fb61cb4-c61c-43cf-b038-0c8eb2372dec taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.120033] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-3fb61cb4-c61c-43cf-b038-0c8eb2372dec" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.120033] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-3fb61cb4-c61c-43cf-b038-0c8eb2372dec" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.120033] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-3fb61cb4-c61c-43cf-b038-0c8eb2372dec" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.120467] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3fb61cb4-c61c-43cf-b038-0c8eb2372dec',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.183741] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3507e503-4abd-47ec-8347-82fc9e691881 in Status: SUCCESS [ 861.184034] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.623332] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.623727] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.623727] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.624053] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.624285] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.624512] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 3fb61cb4-c61c-43cf-b038-0c8eb2372dec not found, creating... [ 861.624834] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.624999] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.625309] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.625460] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.625555] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.625846] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.626378] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.629168] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.629421] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.629584] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.629766] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 3fb61cb4-c61c-43cf-b038-0c8eb2372dec is going to be created. [ 861.650791] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.651063] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.651193] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.651858] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.652138] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.652373] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-3fb61cb4-c61c-43cf-b038-0c8eb2372dec" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.016229] env[70392]: INFO networking_nsxv3.common.synchronization [req-52c26f6d-5cea-4c11-8bcf-b59f32b61cfd req-604472c0-3073-4c20-977a-2739439c2f0a tempest-MultipleCreateTestJSON-1646981689 tempest-MultipleCreateTestJSON-1646981689-project-member] Enqueued Resource ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 with Priority: HIGHEST for action security_group_members [ 862.016866] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 with Priority: HIGHEST for action security_group_members [ 862.017141] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-20f5b49b-d835-491d-a710-e2565f4af8b5 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.017257] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.017316] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.017573] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.017730] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.017821] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.017877] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.018154] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.018154] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.018388] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20f5b49b-d835-491d-a710-e2565f4af8b5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.063240] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 in Status: SUCCESS [ 862.063634] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 deletion is rescheduled due to dependency. [ 862.063634] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.151210] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bca01ddc-73d5-4856-bbff-aefad642492a in Status: UNINITIALIZED for 4s [ 862.306203] env[70392]: INFO networking_nsxv3.common.synchronization [None req-6040d454-88ac-4aa4-969d-4075c67178e2 None None] Enqueued Resource ID: 3f1acecb-f4a4-4350-891e-657cf8b33949 with Priority: HIGHEST for action port [ 862.307057] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f1acecb-f4a4-4350-891e-657cf8b33949 with Priority: HIGHEST for action port [ 862.307231] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-3f1acecb-f4a4-4350-891e-657cf8b33949 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.307380] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3f1acecb-f4a4-4350-891e-657cf8b33949" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.307435] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3f1acecb-f4a4-4350-891e-657cf8b33949" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.307694] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3f1acecb-f4a4-4350-891e-657cf8b33949" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.310056] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3f1acecb-f4a4-4350-891e-657cf8b33949',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.380883] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 12c8b5a9-023e-43d6-a4a6-03004d0ac434 in Status: SUCCESS [ 862.380883] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-12c8b5a9-023e-43d6-a4a6-03004d0ac434" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.523111] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.523111] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.523111] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.523111] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.523111] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.523111] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.523111] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.523111] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.523111] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.523111] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.523111] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 already deleted. [ 862.523111] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.701791] env[70392]: INFO networking_nsxv3.common.synchronization [req-52eb2618-fdf7-42fd-95a5-95452ac3c2f7 req-db9862d6-42a9-4910-836f-f9478ab9db51 service nova] Enqueued Resource ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 with Priority: HIGHEST for action security_group_rules [ 862.701873] env[70392]: INFO networking_nsxv3.common.synchronization [req-52eb2618-fdf7-42fd-95a5-95452ac3c2f7 req-db9862d6-42a9-4910-836f-f9478ab9db51 service nova] Enqueued Resource ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 with Priority: HIGHEST for action security_group_members [ 862.701950] env[70392]: INFO networking_nsxv3.common.synchronization [req-52eb2618-fdf7-42fd-95a5-95452ac3c2f7 req-db9862d6-42a9-4910-836f-f9478ab9db51 service nova] Enqueued Resource ID: 3fb61cb4-c61c-43cf-b038-0c8eb2372dec with Priority: HIGHEST for action port [ 862.702634] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 with Priority: HIGHEST for action security_group_rules [ 862.702771] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 with Priority: HIGHEST for action security_group_members [ 862.702920] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fb61cb4-c61c-43cf-b038-0c8eb2372dec with Priority: HIGHEST for action port [ 862.704404] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b60d7eaa-9583-4c75-97fa-4049c63576b6 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.704551] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.704620] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.704899] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.704956] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b60d7eaa-9583-4c75-97fa-4049c63576b6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.705865] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60d7eaa-9583-4c75-97fa-4049c63576b6 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.705986] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.706060] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.707345] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.707345] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.707345] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.707345] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.707345] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.707345] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.707345] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b60d7eaa-9583-4c75-97fa-4049c63576b6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.713327] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-3fb61cb4-c61c-43cf-b038-0c8eb2372dec taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.713327] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3fb61cb4-c61c-43cf-b038-0c8eb2372dec" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.713327] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3fb61cb4-c61c-43cf-b038-0c8eb2372dec" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.713327] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3fb61cb4-c61c-43cf-b038-0c8eb2372dec" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.713327] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3fb61cb4-c61c-43cf-b038-0c8eb2372dec',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.735740] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-638 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.735740] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-638" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.735740] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-638" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.735740] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-638" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.735740] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.735740] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.735740] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.735740] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.736290] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.736290] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 862.736347] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 862.736530] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 862.736668] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 862.736788] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 862.736907] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 862.737053] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 862.762660] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 862.762874] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 862.763034] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 862.763230] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-638" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.763555] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-5e113c4c-7729-4b09-be2c-1470bb4e55af taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.764457] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-5e113c4c-7729-4b09-be2c-1470bb4e55af" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.764609] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-5e113c4c-7729-4b09-be2c-1470bb4e55af" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.764955] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-5e113c4c-7729-4b09-be2c-1470bb4e55af" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.765118] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e113c4c-7729-4b09-be2c-1470bb4e55af',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.813623] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3f1acecb-f4a4-4350-891e-657cf8b33949 [ 862.813921] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.814077] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.814152] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.814362] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.814460] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.814542] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3f1acecb-f4a4-4350-891e-657cf8b33949 already deleted. [ 862.814626] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3f1acecb-f4a4-4350-891e-657cf8b33949" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.198856] env[70392]: INFO networking_nsxv3.common.synchronization [None req-7442b44c-4b8d-43f7-a445-c46e397d708d tempest-ServerActionsTestOtherB-779604050 tempest-ServerActionsTestOtherB-779604050-project-member] Enqueued Resource ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 with Priority: HIGHEST for action security_group_rules [ 863.198856] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 with Priority: HIGHEST for action security_group_rules [ 863.198856] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.198856] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.198856] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.199486] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.199486] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.216157] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60d7eaa-9583-4c75-97fa-4049c63576b6 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.216157] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.216157] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b60d7eaa-9583-4c75-97fa-4049c63576b6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.218195] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3fb61cb4-c61c-43cf-b038-0c8eb2372dec with status ACTIVE [ 863.218195] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.218195] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.218195] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.218195] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.218195] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.218195] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.218195] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.218195] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.218195] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.218950] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.219333] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.219904] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.219904] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.219904] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.219904] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.219904] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3fb61cb4-c61c-43cf-b038-0c8eb2372dec is going to be updated. [ 863.255995] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.256284] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.256284] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.256617] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.256926] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.257196] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3fb61cb4-c61c-43cf-b038-0c8eb2372dec" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.267882] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.268518] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.268518] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.268653] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.268722] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.268870] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 5e113c4c-7729-4b09-be2c-1470bb4e55af not found, creating... [ 863.269162] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.269347] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.269441] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.269829] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.270044] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.270463] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.270635] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.270754] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.271330] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.272515] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.272730] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 5e113c4c-7729-4b09-be2c-1470bb4e55af is going to be created. [ 863.294983] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.297035] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.297035] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.297035] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.297035] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.297035] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-5e113c4c-7729-4b09-be2c-1470bb4e55af" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.370068] env[70392]: INFO networking_nsxv3.common.synchronization [None req-047b60f8-9eee-46ba-b158-82c08668f16f tempest-ServerActionsTestOtherB-779604050 tempest-ServerActionsTestOtherB-779604050-project-member] Enqueued Resource ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 with Priority: HIGHEST for action security_group_rules [ 863.370068] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 with Priority: HIGHEST for action security_group_rules [ 863.371119] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.371947] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.724226] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b60d7eaa-9583-4c75-97fa-4049c63576b6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.726656] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.726656] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.726656] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.726656] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.726656] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.726845] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 already deleted. [ 863.726845] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.728065] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.728280] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.728390] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.169548] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bca01ddc-73d5-4856-bbff-aefad642492a in Status: SUCCESS [ 864.169914] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.170249] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.170672] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.172292] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.172436] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.172768] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.172768] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.172900] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.172987] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.173209] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bca01ddc-73d5-4856-bbff-aefad642492a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.192999] env[70392]: INFO networking_nsxv3.common.synchronization [req-52c26f6d-5cea-4c11-8bcf-b59f32b61cfd req-41f78d8f-ec09-4fc7-8f95-9af7952f1b03 service nova] Enqueued Resource ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 with Priority: HIGHEST for action security_group_rules [ 864.193286] env[70392]: INFO networking_nsxv3.common.synchronization [req-52c26f6d-5cea-4c11-8bcf-b59f32b61cfd req-41f78d8f-ec09-4fc7-8f95-9af7952f1b03 service nova] Enqueued Resource ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 with Priority: HIGHEST for action security_group_members [ 864.193463] env[70392]: INFO networking_nsxv3.common.synchronization [req-52c26f6d-5cea-4c11-8bcf-b59f32b61cfd req-41f78d8f-ec09-4fc7-8f95-9af7952f1b03 service nova] Enqueued Resource ID: 5e113c4c-7729-4b09-be2c-1470bb4e55af with Priority: HIGHEST for action port [ 864.194140] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 with Priority: HIGHEST for action security_group_rules [ 864.194350] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 with Priority: HIGHEST for action security_group_members [ 864.194488] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e113c4c-7729-4b09-be2c-1470bb4e55af with Priority: HIGHEST for action port [ 864.195162] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-20f5b49b-d835-491d-a710-e2565f4af8b5 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.195330] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.195418] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.195760] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.196718] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('20f5b49b-d835-491d-a710-e2565f4af8b5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.200024] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-20f5b49b-d835-491d-a710-e2565f4af8b5 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.200024] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.200024] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.200024] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.200024] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.200024] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.200024] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.200024] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.200024] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.200024] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20f5b49b-d835-491d-a710-e2565f4af8b5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.200024] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-5e113c4c-7729-4b09-be2c-1470bb4e55af taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.201085] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5e113c4c-7729-4b09-be2c-1470bb4e55af" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.201085] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5e113c4c-7729-4b09-be2c-1470bb4e55af" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.201085] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5e113c4c-7729-4b09-be2c-1470bb4e55af" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.201085] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e113c4c-7729-4b09-be2c-1470bb4e55af',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.228601] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.228792] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.228897] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.229046] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.229142] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.229333] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 is going to be updated. [ 864.259630] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.259630] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.259630] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.259630] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.259630] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.259949] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 already deleted. [ 864.259949] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.303242] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.303418] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.303529] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.303754] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.303909] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.326273] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 in Status: IN_PROGRESS for 2s [ 864.675574] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-bca01ddc-73d5-4856-bbff-aefad642492a taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.675988] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.675988] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.676198] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.676398] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.676555] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.676640] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.676987] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.676987] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.676987] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.677161] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-bca01ddc-73d5-4856-bbff-aefad642492a taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.677267] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.677334] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.677486] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.677657] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.677883] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.677883] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.678132] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.678247] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.678428] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.678646] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bca01ddc-73d5-4856-bbff-aefad642492a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.707963] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-20f5b49b-d835-491d-a710-e2565f4af8b5 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.707963] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.709176] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('20f5b49b-d835-491d-a710-e2565f4af8b5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.709438] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5e113c4c-7729-4b09-be2c-1470bb4e55af with status ACTIVE [ 864.709711] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.709878] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.709957] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.710241] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.710398] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.710667] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.710807] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.712361] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.715585] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.715585] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.715585] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.715585] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.715585] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.715585] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.715585] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.715585] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5e113c4c-7729-4b09-be2c-1470bb4e55af is going to be updated. [ 864.748984] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.749240] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.749390] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.749665] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.749944] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.750228] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5e113c4c-7729-4b09-be2c-1470bb4e55af" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.934956] env[70392]: INFO networking_nsxv3.common.synchronization [req-52c26f6d-5cea-4c11-8bcf-b59f32b61cfd req-ae312751-3c6b-42d8-b22b-2824a338207c tempest-MultipleCreateTestJSON-1646981689 tempest-MultipleCreateTestJSON-1646981689-project-member] Enqueued Resource ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 with Priority: HIGHEST for action security_group_members [ 864.937626] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 with Priority: HIGHEST for action security_group_members [ 864.937626] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-20f5b49b-d835-491d-a710-e2565f4af8b5 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.937626] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.182483] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bca01ddc-73d5-4856-bbff-aefad642492a: rpc.has_security_group_logging(os_id): False [ 865.218505] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('20f5b49b-d835-491d-a710-e2565f4af8b5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.226034] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.226218] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.226480] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.228021] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.228021] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.228021] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.228021] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.228021] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.228021] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.228021] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.228636] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.228636] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.228636] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.228636] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.229022] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.229022] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.229174] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.229174] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.229304] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.229361] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.230464] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bca01ddc-73d5-4856-bbff-aefad642492a is going to be created. [ 865.329754] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.329986] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.330056] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.330397] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.330656] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.352138] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bca01ddc-73d5-4856-bbff-aefad642492a in Status: IN_PROGRESS for 2s [ 865.661040] env[70392]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] NSXv3 Agent Agent loop - iteration:0 completed [ 865.661605] env[70392]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] NSXv3 Agent Agent loop - iteration:1 started [ 865.721274] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.721533] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.721653] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.722289] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.722289] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.722289] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 is going to be created. [ 865.748491] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.748491] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.748491] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.748713] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.748874] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.759181] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 in Status: UNINITIALIZED for 2s [ 865.999105] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-638 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.999331] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-638" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.999494] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-638" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.999767] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-638" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.001131] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.001494] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.001584] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.001857] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.002083] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.002317] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 866.002436] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 866.002553] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 866.002665] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 866.002776] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 866.002883] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 866.003185] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 866.026669] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 866.026868] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 866.027037] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 866.027198] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-638" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.027556] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-3e280379-c598-4539-a0c8-7ae16d1b422c taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.027728] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-3e280379-c598-4539-a0c8-7ae16d1b422c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.027847] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-3e280379-c598-4539-a0c8-7ae16d1b422c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.028195] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-3e280379-c598-4539-a0c8-7ae16d1b422c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.028332] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e280379-c598-4539-a0c8-7ae16d1b422c',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.339040] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 in Status: SUCCESS [ 866.339320] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.340202] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.340534] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.340730] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.340849] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.340916] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.341217] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.341217] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.341283] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.341422] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b60d7eaa-9583-4c75-97fa-4049c63576b6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.533302] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.533546] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.533658] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.533947] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.534117] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.534274] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 3e280379-c598-4539-a0c8-7ae16d1b422c not found, creating... [ 866.534538] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.534695] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.534812] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.535038] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.535179] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.535457] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.535620] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.535735] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.535944] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.538229] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.538475] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 3e280379-c598-4539-a0c8-7ae16d1b422c is going to be created. [ 866.563248] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.563588] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.563805] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.564499] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.564612] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.564855] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-3e280379-c598-4539-a0c8-7ae16d1b422c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.849883] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60d7eaa-9583-4c75-97fa-4049c63576b6 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.849883] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.849883] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.849883] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.849883] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.849883] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.849883] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.849883] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.849883] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.849883] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.849883] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60d7eaa-9583-4c75-97fa-4049c63576b6 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.849883] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.849883] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.849883] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.849883] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.850763] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.850763] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.852172] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.852172] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.852172] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.852172] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b60d7eaa-9583-4c75-97fa-4049c63576b6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.359177] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b60d7eaa-9583-4c75-97fa-4049c63576b6: rpc.has_security_group_logging(os_id): False [ 867.371208] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bca01ddc-73d5-4856-bbff-aefad642492a in Status: SUCCESS [ 867.371475] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.378981] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.379360] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.379360] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.379610] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.379712] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.379918] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.380057] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.380122] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.381305] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.381428] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.381628] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.381748] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.381802] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.381943] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.382027] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.382252] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.382390] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.382452] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.382598] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.382667] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.382778] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 is going to be updated. [ 867.449496] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.449653] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.449688] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.449867] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.450026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.465566] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 in Status: IN_PROGRESS for 2s [ 867.777063] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 in Status: SUCCESS [ 867.777424] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.777651] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.777921] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.778225] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.778383] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.778472] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.778684] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.778790] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.778900] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.779132] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('20f5b49b-d835-491d-a710-e2565f4af8b5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.781026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.781026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.781026] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.781026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.781026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.781273] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.781303] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.781453] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20f5b49b-d835-491d-a710-e2565f4af8b5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.785545] env[70392]: INFO networking_nsxv3.common.synchronization [req-52c26f6d-5cea-4c11-8bcf-b59f32b61cfd req-eaf22a84-cb45-4809-bc24-3980f7e2e1e2 service nova] Enqueued Resource ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 with Priority: HIGHEST for action security_group_rules [ 867.785714] env[70392]: INFO networking_nsxv3.common.synchronization [req-52c26f6d-5cea-4c11-8bcf-b59f32b61cfd req-eaf22a84-cb45-4809-bc24-3980f7e2e1e2 service nova] Enqueued Resource ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 with Priority: HIGHEST for action security_group_members [ 867.785855] env[70392]: INFO networking_nsxv3.common.synchronization [req-52c26f6d-5cea-4c11-8bcf-b59f32b61cfd req-eaf22a84-cb45-4809-bc24-3980f7e2e1e2 service nova] Enqueued Resource ID: 3e280379-c598-4539-a0c8-7ae16d1b422c with Priority: HIGHEST for action port [ 867.786533] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 with Priority: HIGHEST for action security_group_rules [ 867.786661] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 with Priority: HIGHEST for action security_group_members [ 867.786797] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e280379-c598-4539-a0c8-7ae16d1b422c with Priority: HIGHEST for action port [ 867.787103] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-20f5b49b-d835-491d-a710-e2565f4af8b5 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.787208] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.787414] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-20f5b49b-d835-491d-a710-e2565f4af8b5 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.787506] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.787695] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e280379-c598-4539-a0c8-7ae16d1b422c taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.787792] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e280379-c598-4539-a0c8-7ae16d1b422c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.787853] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e280379-c598-4539-a0c8-7ae16d1b422c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.788043] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e280379-c598-4539-a0c8-7ae16d1b422c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.788119] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e280379-c598-4539-a0c8-7ae16d1b422c',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.284089] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-20f5b49b-d835-491d-a710-e2565f4af8b5 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.284089] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.288114] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('20f5b49b-d835-491d-a710-e2565f4af8b5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.290074] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3e280379-c598-4539-a0c8-7ae16d1b422c with status ACTIVE [ 868.293351] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.293351] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.293351] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.293351] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.293351] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.293351] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.293351] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.293351] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.293351] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.293351] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.293351] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.293351] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.293351] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.293351] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.293351] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.293351] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3e280379-c598-4539-a0c8-7ae16d1b422c is going to be updated. [ 868.322615] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.322615] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.322615] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.322615] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.322615] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.322615] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e280379-c598-4539-a0c8-7ae16d1b422c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.790096] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('20f5b49b-d835-491d-a710-e2565f4af8b5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.922760] env[70392]: INFO networking_nsxv3.common.synchronization [req-4c79979a-1347-4a7f-9f93-e3c32b2e57b3 req-ca7801af-582b-45cd-917a-cba3e2fd68e8 tempest-ImagesOneServerNegativeTestJSON-1691594958 tempest-ImagesOneServerNegativeTestJSON-1691594958-project-member] Enqueued Resource ID: dbeb3b19-0a8e-4685-84e0-239c82418063 with Priority: HIGHEST for action security_group_members [ 868.925719] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbeb3b19-0a8e-4685-84e0-239c82418063 with Priority: HIGHEST for action security_group_members [ 868.926221] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbeb3b19-0a8e-4685-84e0-239c82418063 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.926397] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.926500] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.926795] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.927078] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.927178] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.927273] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.928036] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.928036] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.928036] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbeb3b19-0a8e-4685-84e0-239c82418063',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.992057] env[70392]: INFO networking_nsxv3.common.synchronization [req-66bb9516-91e3-4a61-a07d-cbb63c5bb0f1 req-049f65e0-2ea7-4360-bd4d-3cf80745cc18 tempest-InstanceActionsNegativeTestJSON-314319433 tempest-InstanceActionsNegativeTestJSON-314319433-project-member] Enqueued Resource ID: 12100879-b33a-4e8b-8947-ed54d332f821 with Priority: HIGHEST for action security_group_members [ 868.992057] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12100879-b33a-4e8b-8947-ed54d332f821 with Priority: HIGHEST for action security_group_members [ 868.992057] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-12100879-b33a-4e8b-8947-ed54d332f821 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.992057] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12100879-b33a-4e8b-8947-ed54d332f821" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.992057] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12100879-b33a-4e8b-8947-ed54d332f821" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.992057] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12100879-b33a-4e8b-8947-ed54d332f821" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.992483] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.992483] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.992483] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.992587] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.992620] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.992703] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12100879-b33a-4e8b-8947-ed54d332f821',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.294323] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.294323] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.294323] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.294323] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.294323] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.294323] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 is going to be updated. [ 869.323753] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.323910] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.323975] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.324415] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.324563] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.336168] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 in Status: IN_PROGRESS for 2s [ 869.435376] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.435560] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.435624] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.435851] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.464687] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.464687] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.464687] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.464687] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.465017] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.465111] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.465345] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbeb3b19-0a8e-4685-84e0-239c82418063 is going to be updated. [ 869.494853] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.495086] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.495168] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.495435] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.495532] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.495775] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.495910] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.495991] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.496132] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.496239] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.496334] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12100879-b33a-4e8b-8947-ed54d332f821 is going to be updated. [ 869.502434] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 in Status: SUCCESS [ 869.502434] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.508726] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.508852] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.508927] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.510884] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.510884] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.517818] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-686 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.518164] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-686" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.518369] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-686" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.518741] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-686" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.519262] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.519262] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.523253] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.523253] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.523253] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.523253] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 869.523253] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 869.523253] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 869.523253] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 869.523253] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 869.523253] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 869.523253] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 869.526337] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbeb3b19-0a8e-4685-84e0-239c82418063 in Status: IN_PROGRESS for 2s [ 869.559289] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 869.559557] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.038 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 869.559705] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 869.559909] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-686" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.560505] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-74289740-2c93-4805-ac45-8a472518789b taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.560709] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-74289740-2c93-4805-ac45-8a472518789b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.560991] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-74289740-2c93-4805-ac45-8a472518789b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.561294] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-74289740-2c93-4805-ac45-8a472518789b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.561604] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74289740-2c93-4805-ac45-8a472518789b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.586365] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.586558] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.586609] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.588029] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.588029] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.606447] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12100879-b33a-4e8b-8947-ed54d332f821 in Status: IN_PROGRESS for 2s [ 870.069249] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.069249] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.069249] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.069249] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.069249] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.069249] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 74289740-2c93-4805-ac45-8a472518789b not found, creating... [ 870.069249] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.069249] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.070157] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.070157] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.072581] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.072581] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.072581] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.072581] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.072581] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.073044] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.073044] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 74289740-2c93-4805-ac45-8a472518789b is going to be created. [ 870.103852] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.105575] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.105575] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.105575] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.105575] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.105575] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-74289740-2c93-4805-ac45-8a472518789b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.168660] env[70392]: INFO networking_nsxv3.common.synchronization [req-8087bef6-0b47-4c45-a5ae-92cf7eb713a8 req-3a0ffb24-7fe6-4ff2-99c6-5382bbf82f2a tempest-AttachInterfacesTestJSON-2046649887 tempest-AttachInterfacesTestJSON-2046649887-project-member] Enqueued Resource ID: 3507e503-4abd-47ec-8347-82fc9e691881 with Priority: HIGHEST for action security_group_members [ 870.169577] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3507e503-4abd-47ec-8347-82fc9e691881 with Priority: HIGHEST for action security_group_members [ 870.170076] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-3507e503-4abd-47ec-8347-82fc9e691881 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.170284] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.170534] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.170759] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.171075] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.171282] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.171375] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.171658] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.171825] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.172780] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3507e503-4abd-47ec-8347-82fc9e691881',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.678022] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.678022] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.678022] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.678022] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.678022] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.678022] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.678022] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.678022] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.678022] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.678022] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.678022] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3507e503-4abd-47ec-8347-82fc9e691881 is going to be updated. [ 870.703086] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.703551] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.703775] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.704422] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.704699] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.715174] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3507e503-4abd-47ec-8347-82fc9e691881 in Status: IN_PROGRESS for 2s [ 871.350752] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 in Status: SUCCESS [ 871.350752] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.351368] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.351752] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.355125] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.355125] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.355125] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.355125] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.355125] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.355125] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20f5b49b-d835-491d-a710-e2565f4af8b5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.542507] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbeb3b19-0a8e-4685-84e0-239c82418063 in Status: SUCCESS [ 871.542507] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbeb3b19-0a8e-4685-84e0-239c82418063 deletion is rescheduled due to dependency. [ 871.542507] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.605892] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.606076] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.606610] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.606610] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.606740] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.628601] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12100879-b33a-4e8b-8947-ed54d332f821 in Status: SUCCESS [ 871.629021] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12100879-b33a-4e8b-8947-ed54d332f821 deletion is rescheduled due to dependency. [ 871.629274] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12100879-b33a-4e8b-8947-ed54d332f821" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.698855] env[70392]: INFO networking_nsxv3.common.synchronization [req-4c79979a-1347-4a7f-9f93-e3c32b2e57b3 req-95a95fcb-bf2f-4bc0-bf9d-ff9e7f35c3fa service nova] Enqueued Resource ID: dbeb3b19-0a8e-4685-84e0-239c82418063 with Priority: HIGHEST for action security_group_rules [ 871.699166] env[70392]: INFO networking_nsxv3.common.synchronization [req-4c79979a-1347-4a7f-9f93-e3c32b2e57b3 req-95a95fcb-bf2f-4bc0-bf9d-ff9e7f35c3fa service nova] Enqueued Resource ID: dbeb3b19-0a8e-4685-84e0-239c82418063 with Priority: HIGHEST for action security_group_members [ 871.699396] env[70392]: INFO networking_nsxv3.common.synchronization [req-4c79979a-1347-4a7f-9f93-e3c32b2e57b3 req-95a95fcb-bf2f-4bc0-bf9d-ff9e7f35c3fa service nova] Enqueued Resource ID: 74289740-2c93-4805-ac45-8a472518789b with Priority: HIGHEST for action port [ 871.704298] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbeb3b19-0a8e-4685-84e0-239c82418063 with Priority: HIGHEST for action security_group_rules [ 871.704559] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbeb3b19-0a8e-4685-84e0-239c82418063 with Priority: HIGHEST for action security_group_members [ 871.704559] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74289740-2c93-4805-ac45-8a472518789b with Priority: HIGHEST for action port [ 871.707085] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dbeb3b19-0a8e-4685-84e0-239c82418063 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.707085] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.707085] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.707085] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.707085] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dbeb3b19-0a8e-4685-84e0-239c82418063',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.707759] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbeb3b19-0a8e-4685-84e0-239c82418063 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.707873] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.707942] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.709294] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.709491] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.709617] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.709707] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.709888] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.710071] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.710071] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbeb3b19-0a8e-4685-84e0-239c82418063',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.715260] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-74289740-2c93-4805-ac45-8a472518789b taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.715260] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-74289740-2c93-4805-ac45-8a472518789b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.715260] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-74289740-2c93-4805-ac45-8a472518789b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.715260] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-74289740-2c93-4805-ac45-8a472518789b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.715260] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74289740-2c93-4805-ac45-8a472518789b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.858936] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('20f5b49b-d835-491d-a710-e2565f4af8b5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.950372] env[70392]: INFO networking_nsxv3.common.synchronization [req-fe91ba5c-e84c-4367-8312-75fde104073f req-156c8b7f-5523-4d38-aa0b-20715c077d26 tempest-MigrationsAdminTest-1525374997 tempest-MigrationsAdminTest-1525374997-project-member] Enqueued Resource ID: 5fec7002-3137-40f1-a653-f520126396a2 with Priority: HIGHEST for action security_group_members [ 871.951913] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fec7002-3137-40f1-a653-f520126396a2 with Priority: HIGHEST for action security_group_members [ 871.952356] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fec7002-3137-40f1-a653-f520126396a2 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.952576] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.952666] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.953068] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.953205] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.953399] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.953513] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.953823] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.953823] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.953950] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5fec7002-3137-40f1-a653-f520126396a2',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.112517] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.216360] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dbeb3b19-0a8e-4685-84e0-239c82418063',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.217536] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbeb3b19-0a8e-4685-84e0-239c82418063 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.217744] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.217835] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 74289740-2c93-4805-ac45-8a472518789b with status ACTIVE [ 872.218019] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.218184] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.218295] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.218588] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.218702] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.219264] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.219627] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.219827] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.220148] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.220517] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.220517] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.220693] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.220745] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.220912] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.221016] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.221113] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 74289740-2c93-4805-ac45-8a472518789b is going to be updated. [ 872.248399] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.248656] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.248656] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.248860] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.249017] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.249190] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-74289740-2c93-4805-ac45-8a472518789b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.363879] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('20f5b49b-d835-491d-a710-e2565f4af8b5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.456824] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5fec7002-3137-40f1-a653-f520126396a2',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.619713] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.726023] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dbeb3b19-0a8e-4685-84e0-239c82418063',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.726193] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3507e503-4abd-47ec-8347-82fc9e691881 in Status: SUCCESS [ 872.726323] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3507e503-4abd-47ec-8347-82fc9e691881 deletion is rescheduled due to dependency. [ 872.726428] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.865316] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.872289] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.872289] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.872289] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.872289] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.872289] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 is going to be updated. [ 872.904730] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.904989] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.905715] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.905715] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.905715] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.919081] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 in Status: IN_PROGRESS for 2s [ 872.960465] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5fec7002-3137-40f1-a653-f520126396a2',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.037266] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-325 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.037266] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-325" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.037266] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-325" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.037266] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-325" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.037266] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.037266] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.037266] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.037266] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.037266] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.037266] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 873.037266] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 873.037266] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 873.037715] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 873.037715] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 873.037715] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 873.037804] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 873.060359] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 873.060636] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 873.060911] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 873.061082] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-325" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.061439] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-3e1d9cae-85a9-4f13-b4b6-17fb2d4781b2 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.061630] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-3e1d9cae-85a9-4f13-b4b6-17fb2d4781b2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.061815] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-3e1d9cae-85a9-4f13-b4b6-17fb2d4781b2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.062500] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-3e1d9cae-85a9-4f13-b4b6-17fb2d4781b2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.062688] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e1d9cae-85a9-4f13-b4b6-17fb2d4781b2',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.124038] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 873.124038] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 873.230600] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.230780] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.230853] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.231087] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.231174] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.231271] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbeb3b19-0a8e-4685-84e0-239c82418063 is going to be updated. [ 873.287778] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.287943] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.288403] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.288403] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.288403] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.299903] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbeb3b19-0a8e-4685-84e0-239c82418063 in Status: IN_PROGRESS for 2s [ 873.398472] env[70392]: INFO networking_nsxv3.common.synchronization [req-cf755295-859a-437d-8513-dfed6b1a0ca7 req-5cbc0ae4-abf2-4d2a-a077-112400ff3ca0 tempest-AttachInterfacesTestJSON-2046649887 tempest-AttachInterfacesTestJSON-2046649887-project-member] Enqueued Resource ID: c1385665-0c09-423f-98c4-4d6b46c66ec0 with Priority: HIGHEST for action security_group_members [ 873.398472] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1385665-0c09-423f-98c4-4d6b46c66ec0 with Priority: HIGHEST for action security_group_members [ 873.398472] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1385665-0c09-423f-98c4-4d6b46c66ec0 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.398472] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1385665-0c09-423f-98c4-4d6b46c66ec0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.398472] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1385665-0c09-423f-98c4-4d6b46c66ec0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.398472] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1385665-0c09-423f-98c4-4d6b46c66ec0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.398472] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.398472] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.399138] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.399539] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.399750] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.400016] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c1385665-0c09-423f-98c4-4d6b46c66ec0',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.464202] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.465087] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.465766] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.465766] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.465766] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.466596] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5fec7002-3137-40f1-a653-f520126396a2 is going to be updated. [ 873.516976] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.517603] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.517891] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.518290] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.518818] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.530557] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5fec7002-3137-40f1-a653-f520126396a2 in Status: IN_PROGRESS for 2s [ 873.565665] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.565954] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.566135] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.566495] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.567963] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.567963] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 3e1d9cae-85a9-4f13-b4b6-17fb2d4781b2 not found, creating... [ 873.567963] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.567963] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.567963] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.567963] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.567963] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.569061] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.569340] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.571339] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.571709] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.571926] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.572727] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 3e1d9cae-85a9-4f13-b4b6-17fb2d4781b2 is going to be created. [ 873.600304] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.600636] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.600920] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.601208] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.601528] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.601862] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-3e1d9cae-85a9-4f13-b4b6-17fb2d4781b2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.637976] env[70392]: INFO networking_nsxv3.common.synchronization [None req-0c0f7055-f602-4874-a900-4351d7fa61c4 None None] Enqueued Resource ID: fba348ff-82c4-46d8-ad29-c7d2e2f967c2 with Priority: HIGHEST for action port [ 873.638657] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fba348ff-82c4-46d8-ad29-c7d2e2f967c2 with Priority: HIGHEST for action port [ 873.639405] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-fba348ff-82c4-46d8-ad29-c7d2e2f967c2 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.639628] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fba348ff-82c4-46d8-ad29-c7d2e2f967c2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.639775] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fba348ff-82c4-46d8-ad29-c7d2e2f967c2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.640554] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fba348ff-82c4-46d8-ad29-c7d2e2f967c2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.640744] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fba348ff-82c4-46d8-ad29-c7d2e2f967c2',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.905414] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.905545] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.905596] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.907112] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.937702] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.937989] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.938310] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.938310] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.938591] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.938683] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.938794] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1385665-0c09-423f-98c4-4d6b46c66ec0 is going to be updated. [ 873.989614] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.989802] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.989877] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.990944] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.991189] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.004845] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1385665-0c09-423f-98c4-4d6b46c66ec0 in Status: IN_PROGRESS for 2s [ 874.143663] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fba348ff-82c4-46d8-ad29-c7d2e2f967c2 [ 874.144224] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.144531] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.144714] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.145018] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.145206] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.145547] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fba348ff-82c4-46d8-ad29-c7d2e2f967c2 already deleted. [ 874.145547] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fba348ff-82c4-46d8-ad29-c7d2e2f967c2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.386033] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.386261] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.386309] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.386578] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.407655] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 874.408857] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.410222] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 874.443187] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.443187] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.443187] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.443187] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.451854] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.451943] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 874.452083] env[70392]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=70392) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 874.452247] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 874.500850] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.505127] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.505127] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.505127] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.506900] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.506900] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 874.599514] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.602769] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.602890] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.603130] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.603378] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.604751] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 874.678621] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.678621] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.678621] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.678621] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.678621] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.678621] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:33. [ 874.678621] env[70392]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'8672d193-ffc9-46be-83d4-064399b66865', '440b9e9c-7b34-46fd-9988-db4bdb111a55', 'e91c56eb-c593-402a-8bcc-78c2b86ccae6', '247680ec-824d-41ac-8735-1edb7b119a99', '12c8b5a9-023e-43d6-a4a6-03004d0ac434', '47a435cb-d815-4f84-b215-41c82faf33b9', '5fec7002-3137-40f1-a653-f520126396a2', 'bc70a526-b91f-4303-b621-493cba506202', 'ce79170a-31ce-429e-8e08-a911557872f4', 'f54639a3-c11e-4833-b47a-e0b477c46dd5', 'eee84844-ea79-48de-9294-c53a759dc328', '5142002e-26fc-486e-b9c2-236f95ba1fa4', '7f78f149-d978-4089-8aa8-d480e7d7bb61', '5ade0934-09a2-4e5c-ac36-e235101fed11', 'b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f', 'dbeb3b19-0a8e-4685-84e0-239c82418063', '0ff592de-806a-4492-9791-c0de60e8c15a', 'b60d7eaa-9583-4c75-97fa-4049c63576b6', 'c6ed4920-0e6a-4b44-ab86-2e2af45392fb', '87729ccf-b5c1-4c71-b616-13269541067e', 'f0999f45-c89f-488f-b038-36a93b2cdeb4', '12100879-b33a-4e8b-8947-ed54d332f821', 'ac589e4e-a2e5-4716-8490-eecefc1b6a5e', 'bca01ddc-73d5-4856-bbff-aefad642492a', '3507e503-4abd-47ec-8347-82fc9e691881', '839b66b0-e5ba-4f94-b08b-508956410270', '623be016-3395-49f1-ae71-2a2052cde818', 'cca6e4dd-68c9-4fd2-8e1a-cda645da02e4', 'c1385665-0c09-423f-98c4-4d6b46c66ec0', '59adf132-72f4-4d43-847e-1af9bc3c6073', '56238df1-04a7-4a59-9d0f-ea911fb29f15', '03a8a1fe-a465-4403-8e2c-2170f54b59a0', '44698b7f-7125-46d0-837f-5d44d3ee1aea'} {{(pid=70392) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 874.678621] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 874.699204] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.700141] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.700265] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.700514] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.700629] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.700757] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 874.700845] env[70392]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=70392) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 874.701862] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 874.774032] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.774032] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.774032] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.774032] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.774032] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.774535] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 874.774754] env[70392]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=70392) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 874.774968] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 874.775993] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 874.777759] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/33 resources of Type:Security Group Rules [ 874.777759] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8672d193-ffc9-46be-83d4-064399b66865 with Priority: HIGH for action security_group_rules [ 874.777759] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 440b9e9c-7b34-46fd-9988-db4bdb111a55 with Priority: HIGH for action security_group_rules [ 874.777759] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e91c56eb-c593-402a-8bcc-78c2b86ccae6 with Priority: HIGH for action security_group_rules [ 874.777759] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 247680ec-824d-41ac-8735-1edb7b119a99 with Priority: HIGH for action security_group_rules [ 874.777759] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 12c8b5a9-023e-43d6-a4a6-03004d0ac434 with Priority: HIGH for action security_group_rules [ 874.777759] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 47a435cb-d815-4f84-b215-41c82faf33b9 with Priority: HIGH for action security_group_rules [ 874.777759] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5fec7002-3137-40f1-a653-f520126396a2 with Priority: HIGH for action security_group_rules [ 874.777759] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bc70a526-b91f-4303-b621-493cba506202 with Priority: HIGH for action security_group_rules [ 874.777759] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ce79170a-31ce-429e-8e08-a911557872f4 with Priority: HIGH for action security_group_rules [ 874.777759] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 with Priority: HIGH for action security_group_rules [ 874.777759] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: eee84844-ea79-48de-9294-c53a759dc328 with Priority: HIGH for action security_group_rules [ 874.777759] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5142002e-26fc-486e-b9c2-236f95ba1fa4 with Priority: HIGH for action security_group_rules [ 874.777759] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7f78f149-d978-4089-8aa8-d480e7d7bb61 with Priority: HIGH for action security_group_rules [ 874.777759] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5ade0934-09a2-4e5c-ac36-e235101fed11 with Priority: HIGH for action security_group_rules [ 874.777759] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f with Priority: HIGH for action security_group_rules [ 874.777759] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dbeb3b19-0a8e-4685-84e0-239c82418063 with Priority: HIGH for action security_group_rules [ 874.777759] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0ff592de-806a-4492-9791-c0de60e8c15a with Priority: HIGH for action security_group_rules [ 874.777759] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 with Priority: HIGH for action security_group_rules [ 874.777759] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c6ed4920-0e6a-4b44-ab86-2e2af45392fb with Priority: HIGH for action security_group_rules [ 874.777759] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 87729ccf-b5c1-4c71-b616-13269541067e with Priority: HIGH for action security_group_rules [ 874.777759] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.935211] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 in Status: SUCCESS [ 874.935618] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.935726] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.935961] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.936210] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.936452] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.936452] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.936723] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.936862] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.937026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.937203] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-20f5b49b-d835-491d-a710-e2565f4af8b5 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.937342] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.937430] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.937619] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.937841] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.938065] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.938065] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.938225] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.938334] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.938447] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.938566] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('20f5b49b-d835-491d-a710-e2565f4af8b5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.139065] env[70392]: INFO networking_nsxv3.common.synchronization [req-fe91ba5c-e84c-4367-8312-75fde104073f req-d43852ea-7a8e-4c49-b58b-b90736bcf9c0 service nova] Enqueued Resource ID: 5fec7002-3137-40f1-a653-f520126396a2 with Priority: HIGHEST for action security_group_rules [ 875.139293] env[70392]: INFO networking_nsxv3.common.synchronization [req-fe91ba5c-e84c-4367-8312-75fde104073f req-d43852ea-7a8e-4c49-b58b-b90736bcf9c0 service nova] Enqueued Resource ID: 5fec7002-3137-40f1-a653-f520126396a2 with Priority: HIGHEST for action security_group_members [ 875.139438] env[70392]: INFO networking_nsxv3.common.synchronization [req-fe91ba5c-e84c-4367-8312-75fde104073f req-d43852ea-7a8e-4c49-b58b-b90736bcf9c0 service nova] Enqueued Resource ID: 3e1d9cae-85a9-4f13-b4b6-17fb2d4781b2 with Priority: HIGHEST for action port [ 875.140058] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fec7002-3137-40f1-a653-f520126396a2 with Priority: HIGHEST for action security_group_rules [ 875.140216] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fec7002-3137-40f1-a653-f520126396a2 with Priority: HIGHEST for action security_group_members [ 875.140632] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e1d9cae-85a9-4f13-b4b6-17fb2d4781b2 with Priority: HIGHEST for action port [ 875.140632] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8672d193-ffc9-46be-83d4-064399b66865 with Priority: HIGH for action security_group_rules [ 875.140632] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e91c56eb-c593-402a-8bcc-78c2b86ccae6 with Priority: HIGH for action security_group_rules [ 875.141226] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fec7002-3137-40f1-a653-f520126396a2 with Priority: HIGH for action security_group_rules [ 875.141425] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f with Priority: HIGH for action security_group_rules [ 875.142230] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87729ccf-b5c1-4c71-b616-13269541067e with Priority: HIGH for action security_group_rules [ 875.142230] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6ed4920-0e6a-4b44-ab86-2e2af45392fb with Priority: HIGH for action security_group_rules [ 875.142230] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 with Priority: HIGH for action security_group_rules [ 875.142230] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ff592de-806a-4492-9791-c0de60e8c15a with Priority: HIGH for action security_group_rules [ 875.142230] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ade0934-09a2-4e5c-ac36-e235101fed11 with Priority: HIGH for action security_group_rules [ 875.142518] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbeb3b19-0a8e-4685-84e0-239c82418063 with Priority: HIGH for action security_group_rules [ 875.143221] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f78f149-d978-4089-8aa8-d480e7d7bb61 with Priority: HIGH for action security_group_rules [ 875.143221] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5142002e-26fc-486e-b9c2-236f95ba1fa4 with Priority: HIGH for action security_group_rules [ 875.143221] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eee84844-ea79-48de-9294-c53a759dc328 with Priority: HIGH for action security_group_rules [ 875.143221] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 with Priority: HIGH for action security_group_rules [ 875.143221] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce79170a-31ce-429e-8e08-a911557872f4 with Priority: HIGH for action security_group_rules [ 875.143221] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47a435cb-d815-4f84-b215-41c82faf33b9 with Priority: HIGH for action security_group_rules [ 875.143435] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc70a526-b91f-4303-b621-493cba506202 with Priority: HIGH for action security_group_rules [ 875.143435] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12c8b5a9-023e-43d6-a4a6-03004d0ac434 with Priority: HIGH for action security_group_rules [ 875.143502] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 440b9e9c-7b34-46fd-9988-db4bdb111a55 with Priority: HIGH for action security_group_rules [ 875.143573] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 247680ec-824d-41ac-8735-1edb7b119a99 with Priority: HIGH for action security_group_rules [ 875.143907] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5fec7002-3137-40f1-a653-f520126396a2 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.144051] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.144123] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.144336] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.144415] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5fec7002-3137-40f1-a653-f520126396a2',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.145379] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fec7002-3137-40f1-a653-f520126396a2 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.145470] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.145653] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e1d9cae-85a9-4f13-b4b6-17fb2d4781b2 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.145754] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e1d9cae-85a9-4f13-b4b6-17fb2d4781b2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.145817] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e1d9cae-85a9-4f13-b4b6-17fb2d4781b2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.146018] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e1d9cae-85a9-4f13-b4b6-17fb2d4781b2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.146108] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e1d9cae-85a9-4f13-b4b6-17fb2d4781b2',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.147214] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8672d193-ffc9-46be-83d4-064399b66865 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.147328] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8672d193-ffc9-46be-83d4-064399b66865" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.147395] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8672d193-ffc9-46be-83d4-064399b66865" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.148571] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8672d193-ffc9-46be-83d4-064399b66865" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.148571] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8672d193-ffc9-46be-83d4-064399b66865',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.148571] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e91c56eb-c593-402a-8bcc-78c2b86ccae6 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.150370] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e91c56eb-c593-402a-8bcc-78c2b86ccae6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.150370] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e91c56eb-c593-402a-8bcc-78c2b86ccae6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.150370] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e91c56eb-c593-402a-8bcc-78c2b86ccae6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.150370] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e91c56eb-c593-402a-8bcc-78c2b86ccae6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.150370] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5fec7002-3137-40f1-a653-f520126396a2 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.150370] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.150370] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.150370] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.150370] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.150876] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.150876] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.151860] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-87729ccf-b5c1-4c71-b616-13269541067e taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.152448] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-87729ccf-b5c1-4c71-b616-13269541067e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.152448] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-87729ccf-b5c1-4c71-b616-13269541067e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.152448] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-87729ccf-b5c1-4c71-b616-13269541067e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.152448] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('87729ccf-b5c1-4c71-b616-13269541067e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.153295] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c6ed4920-0e6a-4b44-ab86-2e2af45392fb taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.153385] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c6ed4920-0e6a-4b44-ab86-2e2af45392fb" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.153421] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c6ed4920-0e6a-4b44-ab86-2e2af45392fb" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.153567] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c6ed4920-0e6a-4b44-ab86-2e2af45392fb" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.153637] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c6ed4920-0e6a-4b44-ab86-2e2af45392fb',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.154679] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b60d7eaa-9583-4c75-97fa-4049c63576b6 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.155334] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.155334] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.155334] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.155334] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b60d7eaa-9583-4c75-97fa-4049c63576b6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.156338] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ff592de-806a-4492-9791-c0de60e8c15a taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.156673] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ff592de-806a-4492-9791-c0de60e8c15a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.156673] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ff592de-806a-4492-9791-c0de60e8c15a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.156673] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ff592de-806a-4492-9791-c0de60e8c15a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.156872] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ff592de-806a-4492-9791-c0de60e8c15a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.157893] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5ade0934-09a2-4e5c-ac36-e235101fed11 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.157893] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5ade0934-09a2-4e5c-ac36-e235101fed11" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.157893] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5ade0934-09a2-4e5c-ac36-e235101fed11" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.157893] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5ade0934-09a2-4e5c-ac36-e235101fed11" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.158212] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5ade0934-09a2-4e5c-ac36-e235101fed11',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.161737] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dbeb3b19-0a8e-4685-84e0-239c82418063 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.161737] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.161737] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f78f149-d978-4089-8aa8-d480e7d7bb61 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.161737] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f78f149-d978-4089-8aa8-d480e7d7bb61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.161737] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f78f149-d978-4089-8aa8-d480e7d7bb61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.162094] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f78f149-d978-4089-8aa8-d480e7d7bb61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.162741] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f78f149-d978-4089-8aa8-d480e7d7bb61',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.164786] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5142002e-26fc-486e-b9c2-236f95ba1fa4 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.164914] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5142002e-26fc-486e-b9c2-236f95ba1fa4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.164975] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5142002e-26fc-486e-b9c2-236f95ba1fa4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.165187] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5142002e-26fc-486e-b9c2-236f95ba1fa4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.165274] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5142002e-26fc-486e-b9c2-236f95ba1fa4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.166427] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eee84844-ea79-48de-9294-c53a759dc328 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.166562] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.166972] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.166972] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.166972] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eee84844-ea79-48de-9294-c53a759dc328',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.167993] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f54639a3-c11e-4833-b47a-e0b477c46dd5 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.168118] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.168183] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.168353] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.168550] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f54639a3-c11e-4833-b47a-e0b477c46dd5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.169323] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ce79170a-31ce-429e-8e08-a911557872f4 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.169434] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.169499] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.170750] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.170750] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ce79170a-31ce-429e-8e08-a911557872f4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.170750] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-47a435cb-d815-4f84-b215-41c82faf33b9 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.170750] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.170750] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.171025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.171025] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('47a435cb-d815-4f84-b215-41c82faf33b9',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.171870] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bc70a526-b91f-4303-b621-493cba506202 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.171981] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bc70a526-b91f-4303-b621-493cba506202" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.172046] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bc70a526-b91f-4303-b621-493cba506202" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.172185] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bc70a526-b91f-4303-b621-493cba506202" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.172249] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bc70a526-b91f-4303-b621-493cba506202',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.173711] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-12c8b5a9-023e-43d6-a4a6-03004d0ac434 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.174081] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-12c8b5a9-023e-43d6-a4a6-03004d0ac434" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.174081] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-12c8b5a9-023e-43d6-a4a6-03004d0ac434" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.174081] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-12c8b5a9-023e-43d6-a4a6-03004d0ac434" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.174222] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('12c8b5a9-023e-43d6-a4a6-03004d0ac434',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.174906] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-440b9e9c-7b34-46fd-9988-db4bdb111a55 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.175010] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-440b9e9c-7b34-46fd-9988-db4bdb111a55" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.175097] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-440b9e9c-7b34-46fd-9988-db4bdb111a55" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.175789] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-440b9e9c-7b34-46fd-9988-db4bdb111a55" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.175789] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('440b9e9c-7b34-46fd-9988-db4bdb111a55',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.176467] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-247680ec-824d-41ac-8735-1edb7b119a99 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.176593] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-247680ec-824d-41ac-8735-1edb7b119a99" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.176691] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-247680ec-824d-41ac-8735-1edb7b119a99" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.176770] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-247680ec-824d-41ac-8735-1edb7b119a99" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.176925] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('247680ec-824d-41ac-8735-1edb7b119a99',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.177494] env[70392]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 875.212869] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.213137] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.213137] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.213327] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.245047] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.245047] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8672d193-ffc9-46be-83d4-064399b66865 is going to be deleted. [ 875.302716] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.302907] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.302969] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.303152] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.303362] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.303453] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8672d193-ffc9-46be-83d4-064399b66865" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.315087] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbeb3b19-0a8e-4685-84e0-239c82418063 in Status: SUCCESS [ 875.315087] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.315087] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.315087] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.315087] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.315087] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.315087] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.315087] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.315087] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.315087] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.315087] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dbeb3b19-0a8e-4685-84e0-239c82418063',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.442774] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 20f5b49b-d835-491d-a710-e2565f4af8b5: rpc.has_security_group_logging(os_id): False [ 875.467261] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.467261] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.467673] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.468533] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.468533] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.469043] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.469982] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.469982] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.469982] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.470439] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.474097] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.474097] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.474097] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.474097] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.474097] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.474097] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.474097] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.474097] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.474555] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.474555] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.474555] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 is going to be created. [ 875.542503] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5fec7002-3137-40f1-a653-f520126396a2 in Status: SUCCESS [ 875.542744] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.542932] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.543262] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.543354] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.543569] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.543649] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.543781] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.543861] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.543957] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5fec7002-3137-40f1-a653-f520126396a2',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.567148] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.567430] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.567430] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.567641] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.567906] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.581378] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 in Status: IN_PROGRESS for 2s [ 875.679765] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fec7002-3137-40f1-a653-f520126396a2 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.679927] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.681204] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3e1d9cae-85a9-4f13-b4b6-17fb2d4781b2 with status ACTIVE [ 875.681399] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.681826] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.681826] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.681826] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.681992] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.682103] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.682192] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.682242] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.682432] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.682504] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.682710] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.682710] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.682918] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.682918] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.683030] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.684837] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3e1d9cae-85a9-4f13-b4b6-17fb2d4781b2 is going to be updated. [ 875.709924] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-5142002e-26fc-486e-b9c2-236f95ba1fa4 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.713627] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5142002e-26fc-486e-b9c2-236f95ba1fa4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.713627] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5142002e-26fc-486e-b9c2-236f95ba1fa4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.713943] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5142002e-26fc-486e-b9c2-236f95ba1fa4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.714055] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.714161] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.714254] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.714479] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.714610] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.714727] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5142002e-26fc-486e-b9c2-236f95ba1fa4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.714854] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5142002e-26fc-486e-b9c2-236f95ba1fa4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.723357] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.723357] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.723675] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.724455] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.724455] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.724455] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e1d9cae-85a9-4f13-b4b6-17fb2d4781b2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.725278] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-eee84844-ea79-48de-9294-c53a759dc328 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.725552] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.725628] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.727568] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.727568] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.727568] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.727568] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.727568] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.727568] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.727568] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.727568] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eee84844-ea79-48de-9294-c53a759dc328',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.728505] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-12c8b5a9-023e-43d6-a4a6-03004d0ac434 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.728505] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12c8b5a9-023e-43d6-a4a6-03004d0ac434" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.728505] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12c8b5a9-023e-43d6-a4a6-03004d0ac434" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.729266] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12c8b5a9-023e-43d6-a4a6-03004d0ac434" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.729266] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.729266] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.729266] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.729266] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.729425] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.729519] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12c8b5a9-023e-43d6-a4a6-03004d0ac434" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.729600] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('12c8b5a9-023e-43d6-a4a6-03004d0ac434',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.730769] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-247680ec-824d-41ac-8735-1edb7b119a99 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.730908] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-247680ec-824d-41ac-8735-1edb7b119a99" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.731008] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-247680ec-824d-41ac-8735-1edb7b119a99" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.731216] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-247680ec-824d-41ac-8735-1edb7b119a99" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.731417] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.731557] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.731637] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.731827] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.731937] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.732081] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-247680ec-824d-41ac-8735-1edb7b119a99" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.732210] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('247680ec-824d-41ac-8735-1edb7b119a99',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.735132] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-47a435cb-d815-4f84-b215-41c82faf33b9 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.735251] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.735315] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.735440] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.735593] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.735701] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.735779] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.735876] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.735944] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.736047] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.736161] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('47a435cb-d815-4f84-b215-41c82faf33b9',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.742018] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f78f149-d978-4089-8aa8-d480e7d7bb61 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.742018] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f78f149-d978-4089-8aa8-d480e7d7bb61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.742018] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f78f149-d978-4089-8aa8-d480e7d7bb61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.742167] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f78f149-d978-4089-8aa8-d480e7d7bb61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.742285] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.742372] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.742372] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.742520] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.742605] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.742691] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f78f149-d978-4089-8aa8-d480e7d7bb61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.742981] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7f78f149-d978-4089-8aa8-d480e7d7bb61',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.746259] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-f54639a3-c11e-4833-b47a-e0b477c46dd5 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.746489] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.746489] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.746660] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.746814] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.746913] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.746970] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.747130] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.747212] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.747294] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.747380] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f54639a3-c11e-4833-b47a-e0b477c46dd5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.748274] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60d7eaa-9583-4c75-97fa-4049c63576b6 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.748380] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.748425] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.748762] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.748762] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.748873] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.748873] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.749066] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.749066] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.749207] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.749260] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b60d7eaa-9583-4c75-97fa-4049c63576b6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.757584] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.757874] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.757874] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.758188] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.800731] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.800857] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.801851] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.801973] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.804031] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.804031] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.805313] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.805432] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.807092] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.807092] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.807347] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.807347] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.811391] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.811391] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.811391] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.811391] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.811391] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.811391] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e91c56eb-c593-402a-8bcc-78c2b86ccae6 is going to be deleted. [ 875.812452] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.812662] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.817263] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbeb3b19-0a8e-4685-84e0-239c82418063 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.817483] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.817483] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.817724] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.817914] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.818036] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.818112] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.818271] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.818352] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.818490] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.818632] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbeb3b19-0a8e-4685-84e0-239c82418063 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.818738] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.818802] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.818950] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.819122] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.819211] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.819269] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.819402] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.819480] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.819557] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.819641] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dbeb3b19-0a8e-4685-84e0-239c82418063',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.836541] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.836716] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ce79170a-31ce-429e-8e08-a911557872f4 is going to be deleted. [ 875.838580] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.838837] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.871050] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.871713] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c6ed4920-0e6a-4b44-ab86-2e2af45392fb is going to be deleted. [ 875.873234] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.873462] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.907221] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.907608] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.911953] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.912173] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ff592de-806a-4492-9791-c0de60e8c15a is going to be deleted. [ 875.914171] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.914171] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.938025] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.938250] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.954099] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.954250] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bc70a526-b91f-4303-b621-493cba506202 is going to be deleted. [ 875.955332] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.955612] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.013814] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.013962] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 440b9e9c-7b34-46fd-9988-db4bdb111a55 is going to be deleted. [ 876.015014] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.015279] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.030620] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.030893] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.037327] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1385665-0c09-423f-98c4-4d6b46c66ec0 in Status: SUCCESS [ 876.037690] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1385665-0c09-423f-98c4-4d6b46c66ec0 deletion is rescheduled due to dependency. [ 876.037906] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1385665-0c09-423f-98c4-4d6b46c66ec0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.046438] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5fec7002-3137-40f1-a653-f520126396a2',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.088175] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.088417] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.090113] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.090113] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5ade0934-09a2-4e5c-ac36-e235101fed11 is going to be deleted. [ 876.091358] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.091489] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.126673] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.126673] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.142408] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.142680] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f is going to be deleted. [ 876.144823] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.145066] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.220264] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.220264] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 87729ccf-b5c1-4c71-b616-13269541067e is going to be deleted. [ 876.221493] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.223048] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.223630] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.223630] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e91c56eb-c593-402a-8bcc-78c2b86ccae6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.224871] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.224871] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.225074] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.225074] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.226057] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5142002e-26fc-486e-b9c2-236f95ba1fa4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.227122] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.227377] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.227515] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.227690] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c6ed4920-0e6a-4b44-ab86-2e2af45392fb" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.228120] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.228417] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.228597] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.231277] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ff592de-806a-4492-9791-c0de60e8c15a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.231277] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.231277] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.231277] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.231277] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bc70a526-b91f-4303-b621-493cba506202" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.250687] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.250857] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.250954] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.251211] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.251313] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.251407] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-440b9e9c-7b34-46fd-9988-db4bdb111a55" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.251799] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-eee84844-ea79-48de-9294-c53a759dc328 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.251909] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.252081] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.252162] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.252319] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.252410] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.252467] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.252609] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.252684] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.253259] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.253582] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-eee84844-ea79-48de-9294-c53a759dc328 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.253695] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.254127] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.254127] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.254127] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.254282] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.254282] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.254829] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.254829] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.254829] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.254829] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eee84844-ea79-48de-9294-c53a759dc328',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.255777] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7f78f149-d978-4089-8aa8-d480e7d7bb61',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.256689] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('47a435cb-d815-4f84-b215-41c82faf33b9',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.264420] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-f54639a3-c11e-4833-b47a-e0b477c46dd5 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.264420] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.264420] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.264420] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.264420] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.264420] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.264420] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.264420] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.264420] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.264420] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.264420] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-f54639a3-c11e-4833-b47a-e0b477c46dd5 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.264420] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.264420] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.264420] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.264420] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.264420] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.265581] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.265581] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.265581] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.265581] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.265581] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f54639a3-c11e-4833-b47a-e0b477c46dd5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.266371] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('247680ec-824d-41ac-8735-1edb7b119a99',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.270216] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('12c8b5a9-023e-43d6-a4a6-03004d0ac434',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.270216] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60d7eaa-9583-4c75-97fa-4049c63576b6 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.270472] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.270605] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.272020] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.272020] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.272020] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.272020] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.272020] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.272020] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.272020] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.272406] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60d7eaa-9583-4c75-97fa-4049c63576b6 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.272508] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.272640] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.272863] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.273119] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.273436] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.274028] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.274028] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.274028] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.274028] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.274254] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b60d7eaa-9583-4c75-97fa-4049c63576b6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.277523] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.277932] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.277932] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.278197] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.278367] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.278542] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8a2cb7e-20dc-47d2-8f7b-d878fb5d585f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.279598] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.279765] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.279869] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.280124] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.280295] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.280472] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5ade0934-09a2-4e5c-ac36-e235101fed11" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.324334] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dbeb3b19-0a8e-4685-84e0-239c82418063: rpc.has_security_group_logging(os_id): False [ 876.357471] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.357649] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.357742] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.358148] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.391153] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.391302] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.442657] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.443215] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.443494] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.443494] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.443683] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.443774] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.444127] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.444281] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.444440] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.444662] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.444786] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.445113] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.445258] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.445369] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.445629] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.445799] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.445950] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dbeb3b19-0a8e-4685-84e0-239c82418063 is going to be updated. [ 876.448014] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.448014] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.448014] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.448014] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-87729ccf-b5c1-4c71-b616-13269541067e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.551486] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5fec7002-3137-40f1-a653-f520126396a2',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.614187] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.614347] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.614419] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.614631] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.614786] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.636507] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dbeb3b19-0a8e-4685-84e0-239c82418063 in Status: IN_PROGRESS for 2s [ 876.728624] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5142002e-26fc-486e-b9c2-236f95ba1fa4: rpc.has_security_group_logging(os_id): False [ 876.753297] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.753461] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.753503] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.753729] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.771511] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 247680ec-824d-41ac-8735-1edb7b119a99: rpc.has_security_group_logging(os_id): False [ 876.773149] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 47a435cb-d815-4f84-b215-41c82faf33b9: rpc.has_security_group_logging(os_id): False [ 876.778417] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7f78f149-d978-4089-8aa8-d480e7d7bb61: rpc.has_security_group_logging(os_id): False [ 876.779793] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f54639a3-c11e-4833-b47a-e0b477c46dd5: rpc.has_security_group_logging(os_id): False [ 876.781028] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eee84844-ea79-48de-9294-c53a759dc328: rpc.has_security_group_logging(os_id): False [ 876.783239] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.783626] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.783793] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.783979] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.784184] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.784305] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.784514] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5142002e-26fc-486e-b9c2-236f95ba1fa4 is going to be updated. [ 876.787703] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 12c8b5a9-023e-43d6-a4a6-03004d0ac434: rpc.has_security_group_logging(os_id): False [ 876.788895] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b60d7eaa-9583-4c75-97fa-4049c63576b6: rpc.has_security_group_logging(os_id): False [ 876.818216] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.818411] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.818411] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.818799] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.821365] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.821365] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.824355] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.824493] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.826226] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.826226] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.830579] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.830579] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.830579] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.830579] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.830579] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.830579] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.847498] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.847969] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.848122] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.848187] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.848393] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.848475] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.848579] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f78f149-d978-4089-8aa8-d480e7d7bb61 is going to be updated. [ 876.850544] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.850544] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.876746] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.876746] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.876746] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.876746] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.876746] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.876746] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.876746] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 47a435cb-d815-4f84-b215-41c82faf33b9 is going to be updated. [ 876.879807] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.879859] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.895043] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.895043] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.899350] env[70392]: INFO networking_nsxv3.common.synchronization [req-5c20c5c9-713c-4547-bc48-516437dfea85 req-04d24841-01c2-4149-bc5a-1a0ca1a0314d tempest-ServersTestBootFromVolume-2123411636 tempest-ServersTestBootFromVolume-2123411636-project-member] Enqueued Resource ID: db50a8fd-2283-44bb-910d-f7a2f2541f14 with Priority: HIGHEST for action security_group_members [ 876.899588] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db50a8fd-2283-44bb-910d-f7a2f2541f14 with Priority: HIGHEST for action security_group_members [ 876.899841] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-db50a8fd-2283-44bb-910d-f7a2f2541f14 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.899974] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db50a8fd-2283-44bb-910d-f7a2f2541f14" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.900030] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db50a8fd-2283-44bb-910d-f7a2f2541f14" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.900297] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db50a8fd-2283-44bb-910d-f7a2f2541f14" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.900465] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.900596] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.900721] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.900834] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.900962] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.902446] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('db50a8fd-2283-44bb-910d-f7a2f2541f14',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.908411] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.908929] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.908929] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.908929] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.909105] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.909258] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.909366] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 12c8b5a9-023e-43d6-a4a6-03004d0ac434 is going to be updated. [ 876.910906] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.913138] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.951042] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.951042] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.953056] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.953430] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.953563] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.953563] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.954108] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.954108] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.954108] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.954536] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.954536] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.954536] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.954536] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.954875] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.954875] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.954875] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.954991] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.955059] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.955124] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eee84844-ea79-48de-9294-c53a759dc328 is going to be updated. [ 876.956830] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.957037] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.009298] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.009470] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.058171] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.060088] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.060088] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.060088] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.060088] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.060088] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5fec7002-3137-40f1-a653-f520126396a2 is going to be updated. [ 877.067937] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.068229] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.068350] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.068414] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.068776] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.068776] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.068962] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.069077] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.069139] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.069311] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.069488] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.069680] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.069760] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.070047] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.070047] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.070239] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.070239] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 is going to be updated. [ 877.071801] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.072052] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.072238] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.073844] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.073844] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.144498] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.144838] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.146293] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.146631] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.146827] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.146896] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.147160] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.147224] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.147562] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.147630] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.147733] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.147920] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.148053] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.148289] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.148408] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.148485] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.148710] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.148782] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.148850] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 is going to be updated. [ 877.150179] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.150404] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.154606] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5142002e-26fc-486e-b9c2-236f95ba1fa4 in Status: IN_PROGRESS for 2s [ 877.169657] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.169856] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.205921] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.206084] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.206407] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.206720] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.206720] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.231201] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5fec7002-3137-40f1-a653-f520126396a2 in Status: IN_PROGRESS for 2s [ 877.233390] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.233727] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.233891] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.233963] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.234169] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.234316] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.234370] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 247680ec-824d-41ac-8735-1edb7b119a99 is going to be updated. [ 877.235534] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.235748] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.236366] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.239419] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.239756] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.239974] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.245490] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.245490] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.245490] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.245490] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.245490] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.245490] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.275737] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 12c8b5a9-023e-43d6-a4a6-03004d0ac434 in Status: IN_PROGRESS for 2s [ 877.283371] env[70392]: INFO networking_nsxv3.common.synchronization [None req-a3bcfe07-3596-4fd3-8227-45f895f60f9c None None] Enqueued Resource ID: 412505df-a38c-4f31-b36f-a939bef83629 with Priority: HIGHEST for action port [ 877.284454] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eee84844-ea79-48de-9294-c53a759dc328 in Status: IN_PROGRESS for 2s [ 877.286044] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 47a435cb-d815-4f84-b215-41c82faf33b9 in Status: SUCCESS [ 877.286310] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.286871] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 412505df-a38c-4f31-b36f-a939bef83629 with Priority: HIGHEST for action port [ 877.287231] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-412505df-a38c-4f31-b36f-a939bef83629 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.287349] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-412505df-a38c-4f31-b36f-a939bef83629" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.287417] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-412505df-a38c-4f31-b36f-a939bef83629" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.287751] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-412505df-a38c-4f31-b36f-a939bef83629" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.287841] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('412505df-a38c-4f31-b36f-a939bef83629',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.301616] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f78f149-d978-4089-8aa8-d480e7d7bb61 in Status: SUCCESS [ 877.301616] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f78f149-d978-4089-8aa8-d480e7d7bb61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.332416] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.332625] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.332668] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.332914] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.333178] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.365641] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.365787] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.367433] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.367433] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.367433] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.405056] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.405317] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.405317] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.405541] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.405731] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.405954] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.406206] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.406206] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.406411] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.406518] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.406601] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db50a8fd-2283-44bb-910d-f7a2f2541f14 already deleted. [ 877.406901] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db50a8fd-2283-44bb-910d-f7a2f2541f14" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.415218] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 in Status: IN_PROGRESS for 2s [ 877.420073] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 in Status: IN_PROGRESS for 2s [ 877.433106] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.433400] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.433522] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.433728] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.433885] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.491632] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 247680ec-824d-41ac-8735-1edb7b119a99 in Status: IN_PROGRESS for 2s [ 877.606036] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 in Status: SUCCESS [ 877.606036] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.606036] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.606384] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.606384] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('20f5b49b-d835-491d-a710-e2565f4af8b5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.724669] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-387 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.724915] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-387" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.725089] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-387" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.725476] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-387" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.725825] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.726138] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.726284] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.726678] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.726870] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.727136] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 877.727382] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 877.727559] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 877.727720] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 877.727874] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 877.728008] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 877.728195] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 877.768311] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 877.768504] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.040 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 877.768693] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 877.768957] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-387" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.769296] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-107e3ce3-a3bc-49e1-9b3b-20245fe91f23 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.769539] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-107e3ce3-a3bc-49e1-9b3b-20245fe91f23" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.769839] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-107e3ce3-a3bc-49e1-9b3b-20245fe91f23" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.773994] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-107e3ce3-a3bc-49e1-9b3b-20245fe91f23" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.773994] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('107e3ce3-a3bc-49e1-9b3b-20245fe91f23',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.790303] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 412505df-a38c-4f31-b36f-a939bef83629 [ 877.790798] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.791043] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.791160] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.791411] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.791537] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.791721] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:412505df-a38c-4f31-b36f-a939bef83629 already deleted. [ 877.791856] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-412505df-a38c-4f31-b36f-a939bef83629" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.109902] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-20f5b49b-d835-491d-a710-e2565f4af8b5 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.110277] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.111094] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.111094] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.111094] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.111094] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.111094] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.111412] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.111412] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.111502] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.111547] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('20f5b49b-d835-491d-a710-e2565f4af8b5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.278652] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.278652] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.278652] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.278652] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.278652] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.281395] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 107e3ce3-a3bc-49e1-9b3b-20245fe91f23 not found, creating... [ 878.281880] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.282092] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.282221] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.282613] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.282831] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.283213] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.283957] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.283957] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.283957] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.284198] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.284232] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 107e3ce3-a3bc-49e1-9b3b-20245fe91f23 is going to be created. [ 878.315837] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.316209] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.316445] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.318043] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.318043] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.318043] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-107e3ce3-a3bc-49e1-9b3b-20245fe91f23" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.614590] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-20f5b49b-d835-491d-a710-e2565f4af8b5 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.614590] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.615211] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.615211] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.615211] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.615211] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.615437] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.615437] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.615536] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.615613] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.615941] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-20f5b49b-d835-491d-a710-e2565f4af8b5 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.615941] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.616204] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.616204] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.616323] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.616509] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.616509] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.616664] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.616754] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.624204] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.624416] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('20f5b49b-d835-491d-a710-e2565f4af8b5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.653184] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dbeb3b19-0a8e-4685-84e0-239c82418063 in Status: SUCCESS [ 878.653543] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.653712] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.653863] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.654129] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dbeb3b19-0a8e-4685-84e0-239c82418063',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.126839] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 20f5b49b-d835-491d-a710-e2565f4af8b5: rpc.has_security_group_logging(os_id): False [ 879.154510] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.154606] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.156437] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.156437] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.156437] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.156437] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.156437] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.156437] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.156874] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.157210] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.157315] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.157428] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.157428] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.157599] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.157664] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.157910] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.158022] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.158194] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.158251] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.158471] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.158471] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 is going to be updated. [ 879.161123] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbeb3b19-0a8e-4685-84e0-239c82418063 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.161123] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.161123] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.161301] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.162109] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.163200] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.163494] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.163724] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.163822] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.163895] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.164034] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dbeb3b19-0a8e-4685-84e0-239c82418063',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.178193] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5142002e-26fc-486e-b9c2-236f95ba1fa4 in Status: SUCCESS [ 879.178944] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5142002e-26fc-486e-b9c2-236f95ba1fa4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.244764] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5fec7002-3137-40f1-a653-f520126396a2 in Status: SUCCESS [ 879.244764] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.246056] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.246056] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.246200] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.246273] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.246335] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.246540] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.246956] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.247533] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.247533] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5fec7002-3137-40f1-a653-f520126396a2',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.250216] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.250350] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.250411] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.250603] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.250819] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.265159] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 in Status: IN_PROGRESS for 2s [ 879.296518] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 12c8b5a9-023e-43d6-a4a6-03004d0ac434 in Status: SUCCESS [ 879.296898] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-12c8b5a9-023e-43d6-a4a6-03004d0ac434" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.311433] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eee84844-ea79-48de-9294-c53a759dc328 in Status: SUCCESS [ 879.311770] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.394410] env[70392]: INFO networking_nsxv3.common.synchronization [req-5c20c5c9-713c-4547-bc48-516437dfea85 req-ed879d16-e886-4127-b03e-af34dd295638 service nova] Enqueued Resource ID: db50a8fd-2283-44bb-910d-f7a2f2541f14 with Priority: HIGHEST for action security_group_rules [ 879.394505] env[70392]: INFO networking_nsxv3.common.synchronization [req-5c20c5c9-713c-4547-bc48-516437dfea85 req-ed879d16-e886-4127-b03e-af34dd295638 service nova] Enqueued Resource ID: db50a8fd-2283-44bb-910d-f7a2f2541f14 with Priority: HIGHEST for action security_group_members [ 879.394600] env[70392]: INFO networking_nsxv3.common.synchronization [req-5c20c5c9-713c-4547-bc48-516437dfea85 req-ed879d16-e886-4127-b03e-af34dd295638 service nova] Enqueued Resource ID: 107e3ce3-a3bc-49e1-9b3b-20245fe91f23 with Priority: HIGHEST for action port [ 879.397689] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db50a8fd-2283-44bb-910d-f7a2f2541f14 with Priority: HIGHEST for action security_group_rules [ 879.397891] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db50a8fd-2283-44bb-910d-f7a2f2541f14 with Priority: HIGHEST for action security_group_members [ 879.397990] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 107e3ce3-a3bc-49e1-9b3b-20245fe91f23 with Priority: HIGHEST for action port [ 879.399028] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-db50a8fd-2283-44bb-910d-f7a2f2541f14 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.399187] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-db50a8fd-2283-44bb-910d-f7a2f2541f14" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.399255] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-db50a8fd-2283-44bb-910d-f7a2f2541f14" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.399462] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-db50a8fd-2283-44bb-910d-f7a2f2541f14" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.399552] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('db50a8fd-2283-44bb-910d-f7a2f2541f14',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.400572] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-db50a8fd-2283-44bb-910d-f7a2f2541f14 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.403144] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db50a8fd-2283-44bb-910d-f7a2f2541f14" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.403144] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db50a8fd-2283-44bb-910d-f7a2f2541f14" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.403144] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db50a8fd-2283-44bb-910d-f7a2f2541f14" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.403144] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.403144] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.403144] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.403144] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.403144] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.403144] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('db50a8fd-2283-44bb-910d-f7a2f2541f14',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.405038] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-107e3ce3-a3bc-49e1-9b3b-20245fe91f23 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.405038] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-107e3ce3-a3bc-49e1-9b3b-20245fe91f23" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.405038] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-107e3ce3-a3bc-49e1-9b3b-20245fe91f23" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.405393] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-107e3ce3-a3bc-49e1-9b3b-20245fe91f23" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.405526] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('107e3ce3-a3bc-49e1-9b3b-20245fe91f23',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.438884] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 in Status: SUCCESS [ 879.438884] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.438884] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 in Status: SUCCESS [ 879.438884] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.510363] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 247680ec-824d-41ac-8735-1edb7b119a99 in Status: SUCCESS [ 879.510363] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-247680ec-824d-41ac-8735-1edb7b119a99" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.667276] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbeb3b19-0a8e-4685-84e0-239c82418063 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.667696] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.667696] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.667820] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.668041] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.668159] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.668252] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.668454] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.668554] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.668702] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.668945] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbeb3b19-0a8e-4685-84e0-239c82418063 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.669076] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.669133] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.669280] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.669415] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.669508] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.669571] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.669713] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.669779] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.669862] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.669950] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dbeb3b19-0a8e-4685-84e0-239c82418063',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.754656] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fec7002-3137-40f1-a653-f520126396a2 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.754872] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.755032] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.755500] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.755928] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.755928] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.756110] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.756157] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.756338] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.756338] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.756505] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fec7002-3137-40f1-a653-f520126396a2 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.756663] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.756780] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.756953] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.757095] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.757191] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.757247] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.757580] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.757580] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.757693] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.757758] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5fec7002-3137-40f1-a653-f520126396a2',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.909159] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('db50a8fd-2283-44bb-910d-f7a2f2541f14',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.909159] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-db50a8fd-2283-44bb-910d-f7a2f2541f14 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.909159] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db50a8fd-2283-44bb-910d-f7a2f2541f14" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.911559] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 107e3ce3-a3bc-49e1-9b3b-20245fe91f23 with status ACTIVE [ 879.911559] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.911559] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.911559] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.911559] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.911559] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.911983] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.911983] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.911983] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.911983] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.911983] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.912258] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.912326] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.912380] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.912515] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.912585] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.912674] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 107e3ce3-a3bc-49e1-9b3b-20245fe91f23 is going to be updated. [ 879.943088] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.943088] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.943088] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.943350] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.945361] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.945995] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-107e3ce3-a3bc-49e1-9b3b-20245fe91f23" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.173082] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dbeb3b19-0a8e-4685-84e0-239c82418063: rpc.has_security_group_logging(os_id): False [ 880.192710] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.192886] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.192933] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.193213] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.193325] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.193547] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.193651] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.193715] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.193897] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.193975] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.194184] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.194282] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.194350] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.194515] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.194610] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.195327] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.195578] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.195578] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.195703] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.195785] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.195874] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dbeb3b19-0a8e-4685-84e0-239c82418063 is going to be updated. [ 880.261038] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5fec7002-3137-40f1-a653-f520126396a2: rpc.has_security_group_logging(os_id): False [ 880.281867] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.282107] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.282188] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.282427] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.282626] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.284605] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.284791] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.284878] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.285051] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.299435] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dbeb3b19-0a8e-4685-84e0-239c82418063 in Status: IN_PROGRESS for 2s [ 880.322802] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.323252] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.323504] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.323504] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.323834] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.323928] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.324191] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.324353] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.324431] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.324670] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.325555] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.325555] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.325555] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.325555] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.325555] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.325822] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.325822] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5fec7002-3137-40f1-a653-f520126396a2 is going to be updated. [ 880.410027] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('db50a8fd-2283-44bb-910d-f7a2f2541f14',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.444347] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.444347] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.444347] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.444347] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.444347] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.462024] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5fec7002-3137-40f1-a653-f520126396a2 in Status: IN_PROGRESS for 2s [ 880.913357] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.913623] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.913661] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.913894] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.913990] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.914132] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db50a8fd-2283-44bb-910d-f7a2f2541f14 is going to be created. [ 880.945076] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.945237] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.945344] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.945504] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.945668] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.958041] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db50a8fd-2283-44bb-910d-f7a2f2541f14 in Status: UNINITIALIZED for 2s [ 881.314155] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 in Status: SUCCESS [ 881.314550] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.319601] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dbeb3b19-0a8e-4685-84e0-239c82418063 in Status: SUCCESS [ 882.319601] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.385430] env[70392]: INFO networking_nsxv3.common.synchronization [req-418c3c6b-242c-411d-9ff5-368b2948a873 req-4c19a032-32bc-4a5b-8852-afd44111acd0 tempest-VolumesAdminNegativeTest-687729453 tempest-VolumesAdminNegativeTest-687729453-project-member] Enqueued Resource ID: fc49f827-a914-4b77-820c-bb2bf63c8bc7 with Priority: HIGHEST for action security_group_members [ 882.385430] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc49f827-a914-4b77-820c-bb2bf63c8bc7 with Priority: HIGHEST for action security_group_members [ 882.385430] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc49f827-a914-4b77-820c-bb2bf63c8bc7 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.385430] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc49f827-a914-4b77-820c-bb2bf63c8bc7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.385430] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc49f827-a914-4b77-820c-bb2bf63c8bc7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.385430] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc49f827-a914-4b77-820c-bb2bf63c8bc7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.385430] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.385430] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.385430] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.385430] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.385430] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.385430] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc49f827-a914-4b77-820c-bb2bf63c8bc7',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.489160] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5fec7002-3137-40f1-a653-f520126396a2 in Status: SUCCESS [ 882.489431] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.489641] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.489864] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.489951] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5fec7002-3137-40f1-a653-f520126396a2',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.881207] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-929 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.881207] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-929" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.881207] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-929" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.881807] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-929" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.882392] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.885021] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.885021] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.885021] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.885021] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.885021] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 882.885021] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 882.885021] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 882.885021] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 882.885021] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 882.885021] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 882.885021] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 882.887705] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.888149] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.888532] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.889198] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.890100] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.890100] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.890100] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.890100] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.892162] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.892162] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.892162] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc49f827-a914-4b77-820c-bb2bf63c8bc7 already deleted. [ 882.892162] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc49f827-a914-4b77-820c-bb2bf63c8bc7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.919944] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 882.920146] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 882.920294] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 882.920732] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-929" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.921101] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-7beeeba8-f756-4d4a-8caf-89a8ccb2574b taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.921257] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-7beeeba8-f756-4d4a-8caf-89a8ccb2574b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.921363] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-7beeeba8-f756-4d4a-8caf-89a8ccb2574b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.921766] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-7beeeba8-f756-4d4a-8caf-89a8ccb2574b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.921987] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7beeeba8-f756-4d4a-8caf-89a8ccb2574b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.975473] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db50a8fd-2283-44bb-910d-f7a2f2541f14 in Status: SUCCESS [ 882.975872] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db50a8fd-2283-44bb-910d-f7a2f2541f14" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.976099] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db50a8fd-2283-44bb-910d-f7a2f2541f14" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.976833] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db50a8fd-2283-44bb-910d-f7a2f2541f14" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.976833] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.977224] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.977224] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.977528] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.977612] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.977699] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db50a8fd-2283-44bb-910d-f7a2f2541f14" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.977830] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('db50a8fd-2283-44bb-910d-f7a2f2541f14',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.994743] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fec7002-3137-40f1-a653-f520126396a2 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.994743] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.994743] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.994743] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.994743] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.995468] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.995468] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.995468] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.995468] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.995468] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.995468] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5fec7002-3137-40f1-a653-f520126396a2',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.424675] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.425038] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.426557] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.426557] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.426557] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.426557] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 7beeeba8-f756-4d4a-8caf-89a8ccb2574b not found, creating... [ 883.426557] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.426557] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.427087] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.428102] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.428932] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.429303] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.430506] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.430506] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.430506] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.430789] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.431073] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 7beeeba8-f756-4d4a-8caf-89a8ccb2574b is going to be created. [ 883.462360] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.462360] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.462360] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.462601] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.465186] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.465186] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-7beeeba8-f756-4d4a-8caf-89a8ccb2574b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.480463] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('db50a8fd-2283-44bb-910d-f7a2f2541f14',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.497534] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fec7002-3137-40f1-a653-f520126396a2 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.497534] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.497978] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.497978] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.498210] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.498344] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.498443] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.498599] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.498717] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.498786] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.498943] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fec7002-3137-40f1-a653-f520126396a2 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.499058] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.499234] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.499375] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.499630] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.499811] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.499811] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.499969] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.500069] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.500231] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.500359] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5fec7002-3137-40f1-a653-f520126396a2',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.985590] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for db50a8fd-2283-44bb-910d-f7a2f2541f14: rpc.has_security_group_logging(os_id): False [ 884.003382] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5fec7002-3137-40f1-a653-f520126396a2: rpc.has_security_group_logging(os_id): False [ 884.008023] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.008302] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.008445] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.008666] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.008825] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.009122] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.009260] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.009353] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.009563] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.013102] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.013102] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: db50a8fd-2283-44bb-910d-f7a2f2541f14 is going to be created. [ 884.074409] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.074660] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.074660] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.074835] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.078112] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.078112] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.078112] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.078112] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.078112] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.078112] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.080339] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.080536] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.080630] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.080932] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.081095] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.081468] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.081695] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.081793] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.082086] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.082217] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.082333] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5fec7002-3137-40f1-a653-f520126396a2 is going to be updated. [ 884.157080] env[70392]: INFO networking_nsxv3.common.synchronization [req-41757271-da99-49a9-a0f2-db36a9feed66 req-171e236d-221f-44d5-af91-63f0cf9ddad1 tempest-MultipleCreateTestJSON-1646981689 tempest-MultipleCreateTestJSON-1646981689-project-member] Enqueued Resource ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 with Priority: HIGHEST for action security_group_members [ 884.158073] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 with Priority: HIGHEST for action security_group_members [ 884.158475] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-20f5b49b-d835-491d-a710-e2565f4af8b5 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.158648] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.158763] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.159068] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.159258] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.159375] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.159442] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.159864] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.159864] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.159864] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20f5b49b-d835-491d-a710-e2565f4af8b5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.191065] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.191065] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.191065] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.191065] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.191065] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.241488] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: db50a8fd-2283-44bb-910d-f7a2f2541f14 in Status: IN_PROGRESS for 2s [ 884.246355] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.246355] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.246355] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.246355] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.246355] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.286581] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5fec7002-3137-40f1-a653-f520126396a2 in Status: IN_PROGRESS for 2s [ 884.632571] env[70392]: INFO networking_nsxv3.common.synchronization [req-418c3c6b-242c-411d-9ff5-368b2948a873 req-030c5807-c70d-4554-bf37-5f3ab4d9409a service nova] Enqueued Resource ID: fc49f827-a914-4b77-820c-bb2bf63c8bc7 with Priority: HIGHEST for action security_group_rules [ 884.632894] env[70392]: INFO networking_nsxv3.common.synchronization [req-418c3c6b-242c-411d-9ff5-368b2948a873 req-030c5807-c70d-4554-bf37-5f3ab4d9409a service nova] Enqueued Resource ID: fc49f827-a914-4b77-820c-bb2bf63c8bc7 with Priority: HIGHEST for action security_group_members [ 884.632894] env[70392]: INFO networking_nsxv3.common.synchronization [req-418c3c6b-242c-411d-9ff5-368b2948a873 req-030c5807-c70d-4554-bf37-5f3ab4d9409a service nova] Enqueued Resource ID: 7beeeba8-f756-4d4a-8caf-89a8ccb2574b with Priority: HIGHEST for action port [ 884.633162] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc49f827-a914-4b77-820c-bb2bf63c8bc7 with Priority: HIGHEST for action security_group_rules [ 884.633292] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc49f827-a914-4b77-820c-bb2bf63c8bc7 with Priority: HIGHEST for action security_group_members [ 884.633408] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7beeeba8-f756-4d4a-8caf-89a8ccb2574b with Priority: HIGHEST for action port [ 884.633992] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fc49f827-a914-4b77-820c-bb2bf63c8bc7 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.634201] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fc49f827-a914-4b77-820c-bb2bf63c8bc7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.634296] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fc49f827-a914-4b77-820c-bb2bf63c8bc7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.634612] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fc49f827-a914-4b77-820c-bb2bf63c8bc7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.634742] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fc49f827-a914-4b77-820c-bb2bf63c8bc7',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.636458] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc49f827-a914-4b77-820c-bb2bf63c8bc7 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.636578] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc49f827-a914-4b77-820c-bb2bf63c8bc7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.636646] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc49f827-a914-4b77-820c-bb2bf63c8bc7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.636837] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc49f827-a914-4b77-820c-bb2bf63c8bc7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.636999] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.637114] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.637173] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.637328] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.637412] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.637504] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc49f827-a914-4b77-820c-bb2bf63c8bc7',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.638396] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-7beeeba8-f756-4d4a-8caf-89a8ccb2574b taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.638525] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7beeeba8-f756-4d4a-8caf-89a8ccb2574b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.638656] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7beeeba8-f756-4d4a-8caf-89a8ccb2574b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.638732] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7beeeba8-f756-4d4a-8caf-89a8ccb2574b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.639130] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7beeeba8-f756-4d4a-8caf-89a8ccb2574b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.664151] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('20f5b49b-d835-491d-a710-e2565f4af8b5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.142992] env[70392]: INFO networking_nsxv3.common.synchronization [req-5a42c23f-43e1-4b21-9ef6-7cd1f3e69801 req-ac3a4f80-d36b-449d-b206-6d9d2a9aa9b6 tempest-SecurityGroupsTestJSON-87195518 tempest-SecurityGroupsTestJSON-87195518-project-member] Enqueued Resource ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b with Priority: HIGHEST for action security_group_members [ 885.144064] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc49f827-a914-4b77-820c-bb2bf63c8bc7 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.146718] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc49f827-a914-4b77-820c-bb2bf63c8bc7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.146891] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fc49f827-a914-4b77-820c-bb2bf63c8bc7',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.147880] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7beeeba8-f756-4d4a-8caf-89a8ccb2574b with status ACTIVE [ 885.150185] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.150185] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.150185] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.150185] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.150185] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.150185] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.150185] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.150185] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.150185] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.150185] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.150185] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.150185] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.150185] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.150185] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.152177] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.152177] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7beeeba8-f756-4d4a-8caf-89a8ccb2574b is going to be updated. [ 885.152177] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b with Priority: HIGHEST for action security_group_members [ 885.152318] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.152464] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.152506] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.155044] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.155044] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.155044] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.155044] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.155044] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.155044] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.155044] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.167174] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('20f5b49b-d835-491d-a710-e2565f4af8b5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.179215] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.179215] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.179215] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.179215] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.179215] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.179215] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7beeeba8-f756-4d4a-8caf-89a8ccb2574b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.423569] env[70392]: INFO networking_nsxv3.common.synchronization [req-94364170-ddb9-4222-98e6-a2c4b96e75dc req-eafb0cbc-de40-4d3f-9c48-51af97a54fdf tempest-MultipleCreateTestJSON-1646981689 tempest-MultipleCreateTestJSON-1646981689-project-member] Enqueued Resource ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 with Priority: HIGHEST for action security_group_members [ 885.424232] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 with Priority: HIGHEST for action security_group_members [ 885.424670] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-20f5b49b-d835-491d-a710-e2565f4af8b5 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.424811] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.659386] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fc49f827-a914-4b77-820c-bb2bf63c8bc7',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.660457] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.660561] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.660628] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.663885] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.663885] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.663885] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.663885] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.663885] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.663885] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.663885] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.663885] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b already deleted. [ 885.663885] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.670301] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.670558] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.670634] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.670897] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.670985] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.671061] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 is going to be updated. [ 885.706785] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.707025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.707113] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.707349] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.707525] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.724051] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 in Status: IN_PROGRESS for 2s [ 885.731993] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-459 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.732252] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-459" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.732414] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-459" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.733696] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-459" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.733696] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.733696] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.733696] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.733696] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.733696] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.734053] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 885.734118] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 885.734676] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 885.734676] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 885.734676] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 885.734676] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 885.734676] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 885.756403] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 885.756627] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 885.756818] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 885.757030] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-459" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.757362] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-16e680e5-61e3-4415-ac6b-add4a154117f taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.757566] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-16e680e5-61e3-4415-ac6b-add4a154117f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.757703] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-16e680e5-61e3-4415-ac6b-add4a154117f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.758093] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-16e680e5-61e3-4415-ac6b-add4a154117f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.758278] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16e680e5-61e3-4415-ac6b-add4a154117f',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.164031] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.164031] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.164270] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.164332] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.164437] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.164525] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc49f827-a914-4b77-820c-bb2bf63c8bc7 is going to be created. [ 886.204384] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.204575] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.204575] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.204745] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.204912] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.221893] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc49f827-a914-4b77-820c-bb2bf63c8bc7 in Status: UNINITIALIZED for 2s [ 886.260247] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: db50a8fd-2283-44bb-910d-f7a2f2541f14 in Status: SUCCESS [ 886.260487] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-db50a8fd-2283-44bb-910d-f7a2f2541f14" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.261138] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.261348] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.262900] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.262900] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.262900] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.262900] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 16e680e5-61e3-4415-ac6b-add4a154117f not found, creating... [ 886.262900] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.262900] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.262900] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.263461] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.263461] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.263523] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.263659] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.263773] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.264104] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.264177] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.264429] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 16e680e5-61e3-4415-ac6b-add4a154117f is going to be created. [ 886.287192] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.287427] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.287563] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.287846] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.288100] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.288336] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-16e680e5-61e3-4415-ac6b-add4a154117f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.307677] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5fec7002-3137-40f1-a653-f520126396a2 in Status: SUCCESS [ 886.307918] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.097090] env[70392]: INFO networking_nsxv3.common.synchronization [req-5a42c23f-43e1-4b21-9ef6-7cd1f3e69801 req-08a4f24d-be57-4442-ac0b-ca00c50b7e1a service nova] Enqueued Resource ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b with Priority: HIGHEST for action security_group_rules [ 887.097421] env[70392]: INFO networking_nsxv3.common.synchronization [req-5a42c23f-43e1-4b21-9ef6-7cd1f3e69801 req-08a4f24d-be57-4442-ac0b-ca00c50b7e1a service nova] Enqueued Resource ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b with Priority: HIGHEST for action security_group_members [ 887.097610] env[70392]: INFO networking_nsxv3.common.synchronization [req-5a42c23f-43e1-4b21-9ef6-7cd1f3e69801 req-08a4f24d-be57-4442-ac0b-ca00c50b7e1a service nova] Enqueued Resource ID: 16e680e5-61e3-4415-ac6b-add4a154117f with Priority: HIGHEST for action port [ 887.098382] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b with Priority: HIGHEST for action security_group_rules [ 887.098567] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b with Priority: HIGHEST for action security_group_members [ 887.098699] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16e680e5-61e3-4415-ac6b-add4a154117f with Priority: HIGHEST for action port [ 887.099106] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.099533] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.099533] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.099689] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.099728] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.101391] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.101580] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.101641] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.101890] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.102124] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.102264] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.102353] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.102571] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.102689] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.102806] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.103842] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-16e680e5-61e3-4415-ac6b-add4a154117f taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.103979] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-16e680e5-61e3-4415-ac6b-add4a154117f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.104077] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-16e680e5-61e3-4415-ac6b-add4a154117f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.105998] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-16e680e5-61e3-4415-ac6b-add4a154117f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.105998] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16e680e5-61e3-4415-ac6b-add4a154117f',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.608535] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.608535] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.608535] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.608535] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 16e680e5-61e3-4415-ac6b-add4a154117f with status ACTIVE [ 887.608535] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.608535] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.608535] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.608535] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.610293] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.610293] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.610293] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.610293] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.610293] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.610293] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.610293] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.610293] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.610293] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.610293] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.610293] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.610293] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 16e680e5-61e3-4415-ac6b-add4a154117f is going to be updated. [ 887.644302] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.644556] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.644556] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.645265] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.645265] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.645265] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-16e680e5-61e3-4415-ac6b-add4a154117f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.717459] env[70392]: INFO networking_nsxv3.common.synchronization [req-511142b9-61e1-41d6-a829-46fe0656b368 req-7dcc5198-5a7a-4b8f-8fdf-ee9bb9296bbe tempest-AttachVolumeNegativeTest-772339566 tempest-AttachVolumeNegativeTest-772339566-project-member] Enqueued Resource ID: 3b776bd0-c07d-4db7-beb4-bf0b0360a21c with Priority: HIGHEST for action security_group_members [ 887.717459] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b776bd0-c07d-4db7-beb4-bf0b0360a21c with Priority: HIGHEST for action security_group_members [ 887.717691] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b776bd0-c07d-4db7-beb4-bf0b0360a21c taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.717911] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b776bd0-c07d-4db7-beb4-bf0b0360a21c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.719477] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b776bd0-c07d-4db7-beb4-bf0b0360a21c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.719477] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b776bd0-c07d-4db7-beb4-bf0b0360a21c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.719477] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.719477] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.719477] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.719477] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.719477] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.719477] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3b776bd0-c07d-4db7-beb4-bf0b0360a21c',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.738301] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 in Status: SUCCESS [ 887.738540] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.739231] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.739366] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.739549] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.739675] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.739802] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.739936] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.740040] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.740132] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20f5b49b-d835-491d-a710-e2565f4af8b5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.114826] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.222064] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.223028] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.223028] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.223028] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.223229] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.223835] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.224039] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.224156] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.226297] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.226421] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.227110] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b776bd0-c07d-4db7-beb4-bf0b0360a21c already deleted. [ 888.227110] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b776bd0-c07d-4db7-beb4-bf0b0360a21c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.247314] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.247574] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.247704] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.248181] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.248181] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.248348] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.248768] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.248768] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.253429] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.253429] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.253429] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 is going to be updated. [ 888.255057] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc49f827-a914-4b77-820c-bb2bf63c8bc7 in Status: SUCCESS [ 888.255206] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc49f827-a914-4b77-820c-bb2bf63c8bc7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.255405] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc49f827-a914-4b77-820c-bb2bf63c8bc7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.255651] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc49f827-a914-4b77-820c-bb2bf63c8bc7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.258027] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.258027] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.258027] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.258027] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.258027] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.258027] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc49f827-a914-4b77-820c-bb2bf63c8bc7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.258027] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fc49f827-a914-4b77-820c-bb2bf63c8bc7',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.302329] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.302532] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.302648] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.304191] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.304191] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.314357] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 in Status: IN_PROGRESS for 2s [ 888.474289] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-483 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.474642] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-483" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.474903] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-483" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.475670] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-483" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.476041] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.476281] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.476424] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.476771] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.477261] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.477261] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 888.477446] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 888.477523] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 888.477652] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 888.477793] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 888.477960] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 888.478264] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 888.507263] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 888.507512] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 888.507707] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 888.507982] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-483" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.508514] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-a56c942d-9898-4d7c-9bad-6510f62bfcb9 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.508706] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-a56c942d-9898-4d7c-9bad-6510f62bfcb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.508877] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-a56c942d-9898-4d7c-9bad-6510f62bfcb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.509270] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-a56c942d-9898-4d7c-9bad-6510f62bfcb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.509473] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a56c942d-9898-4d7c-9bad-6510f62bfcb9',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.621519] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.621879] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.622059] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.622424] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.622536] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.622598] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b is going to be created. [ 888.654226] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.654226] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.654376] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.654517] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.654678] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.667465] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b in Status: UNINITIALIZED for 2s [ 888.764026] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc49f827-a914-4b77-820c-bb2bf63c8bc7 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.764026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc49f827-a914-4b77-820c-bb2bf63c8bc7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.764026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc49f827-a914-4b77-820c-bb2bf63c8bc7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.764026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc49f827-a914-4b77-820c-bb2bf63c8bc7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.764026] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.764026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.764026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.764026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.764026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.764026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc49f827-a914-4b77-820c-bb2bf63c8bc7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.764026] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc49f827-a914-4b77-820c-bb2bf63c8bc7 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.764026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc49f827-a914-4b77-820c-bb2bf63c8bc7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.764026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc49f827-a914-4b77-820c-bb2bf63c8bc7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.764026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc49f827-a914-4b77-820c-bb2bf63c8bc7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.764026] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.764026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.765256] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.765256] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.765256] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.765256] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc49f827-a914-4b77-820c-bb2bf63c8bc7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.765256] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fc49f827-a914-4b77-820c-bb2bf63c8bc7',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.012715] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.012963] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.013120] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.013405] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.013803] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.013968] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port a56c942d-9898-4d7c-9bad-6510f62bfcb9 not found, creating... [ 889.014316] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.014444] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.014513] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.015339] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.015339] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.015526] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.015697] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.015824] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.016081] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.016230] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.016376] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: a56c942d-9898-4d7c-9bad-6510f62bfcb9 is going to be created. [ 889.064152] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.064152] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.065043] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.065043] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.065368] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.065773] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-a56c942d-9898-4d7c-9bad-6510f62bfcb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.151641] env[70392]: INFO networking_nsxv3.common.synchronization [None req-38961093-4d3f-454a-b668-7d5eb9aad7f0 tempest-ServerRescueNegativeTestJSON-197938596 tempest-ServerRescueNegativeTestJSON-197938596-project-member] Enqueued Resource ID: fcc3c75c-0cae-4c7c-8f32-6c948e76880d with Priority: HIGHEST for action security_group_rules [ 889.152534] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcc3c75c-0cae-4c7c-8f32-6c948e76880d with Priority: HIGHEST for action security_group_rules [ 889.153571] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fcc3c75c-0cae-4c7c-8f32-6c948e76880d taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.153571] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fcc3c75c-0cae-4c7c-8f32-6c948e76880d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.153571] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fcc3c75c-0cae-4c7c-8f32-6c948e76880d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.153571] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fcc3c75c-0cae-4c7c-8f32-6c948e76880d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.153922] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fcc3c75c-0cae-4c7c-8f32-6c948e76880d',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.265968] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fc49f827-a914-4b77-820c-bb2bf63c8bc7: rpc.has_security_group_logging(os_id): False [ 889.299285] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.299637] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.299637] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.300062] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.301170] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.301938] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.302321] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.302820] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.303193] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.303354] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.303890] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.304099] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.304226] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.304541] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.304766] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.305088] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.305326] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.305386] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.305605] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.305743] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.305860] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fc49f827-a914-4b77-820c-bb2bf63c8bc7 is going to be created. [ 889.357619] env[70392]: INFO networking_nsxv3.common.synchronization [None req-4d14dac6-7a15-493c-9816-13912d441dfc tempest-ServerRescueNegativeTestJSON-197938596 tempest-ServerRescueNegativeTestJSON-197938596-project-member] Enqueued Resource ID: fcc3c75c-0cae-4c7c-8f32-6c948e76880d with Priority: HIGHEST for action security_group_rules [ 889.358315] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcc3c75c-0cae-4c7c-8f32-6c948e76880d with Priority: HIGHEST for action security_group_rules [ 889.358654] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fcc3c75c-0cae-4c7c-8f32-6c948e76880d taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.358812] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fcc3c75c-0cae-4c7c-8f32-6c948e76880d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.396817] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.396817] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.396817] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.396817] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.396817] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.413763] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fc49f827-a914-4b77-820c-bb2bf63c8bc7 in Status: IN_PROGRESS for 2s [ 889.685647] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.685647] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.685647] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.685647] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.685647] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.685647] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fcc3c75c-0cae-4c7c-8f32-6c948e76880d already deleted. [ 889.685647] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fcc3c75c-0cae-4c7c-8f32-6c948e76880d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.685647] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fcc3c75c-0cae-4c7c-8f32-6c948e76880d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.685647] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fcc3c75c-0cae-4c7c-8f32-6c948e76880d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.685647] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fcc3c75c-0cae-4c7c-8f32-6c948e76880d',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.807932] env[70392]: INFO networking_nsxv3.common.synchronization [req-f9edd2f3-58b0-494e-8151-53a01d94849c req-cd636204-f9dd-4fdd-9ab7-2a38415f8be4 tempest-ImagesOneServerTestJSON-441499339 tempest-ImagesOneServerTestJSON-441499339-project-member] Enqueued Resource ID: 56238df1-04a7-4a59-9d0f-ea911fb29f15 with Priority: HIGHEST for action security_group_members [ 889.808516] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56238df1-04a7-4a59-9d0f-ea911fb29f15 with Priority: HIGHEST for action security_group_members [ 889.808874] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-56238df1-04a7-4a59-9d0f-ea911fb29f15 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.809015] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56238df1-04a7-4a59-9d0f-ea911fb29f15" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.809109] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56238df1-04a7-4a59-9d0f-ea911fb29f15" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.809311] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56238df1-04a7-4a59-9d0f-ea911fb29f15" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.809470] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.809571] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.809632] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.809777] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.809861] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.809956] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('56238df1-04a7-4a59-9d0f-ea911fb29f15',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.205016] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.205372] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.205372] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.205468] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.205564] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.205667] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fcc3c75c-0cae-4c7c-8f32-6c948e76880d already deleted. [ 890.205761] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fcc3c75c-0cae-4c7c-8f32-6c948e76880d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.314234] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.314403] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.314476] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.314694] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.331467] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 in Status: SUCCESS [ 890.331716] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 deletion is rescheduled due to dependency. [ 890.331989] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.344451] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.345941] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.346295] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.346396] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.346618] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.346710] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.346809] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56238df1-04a7-4a59-9d0f-ea911fb29f15 is going to be updated. [ 890.383328] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.383533] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.383827] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.383874] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.384070] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.392310] env[70392]: INFO networking_nsxv3.common.synchronization [req-511142b9-61e1-41d6-a829-46fe0656b368 req-694da1a6-400f-459c-afa3-4e74f124469f service nova] Enqueued Resource ID: 3b776bd0-c07d-4db7-beb4-bf0b0360a21c with Priority: HIGHEST for action security_group_rules [ 890.392310] env[70392]: INFO networking_nsxv3.common.synchronization [req-511142b9-61e1-41d6-a829-46fe0656b368 req-694da1a6-400f-459c-afa3-4e74f124469f service nova] Enqueued Resource ID: 3b776bd0-c07d-4db7-beb4-bf0b0360a21c with Priority: HIGHEST for action security_group_members [ 890.392310] env[70392]: INFO networking_nsxv3.common.synchronization [req-511142b9-61e1-41d6-a829-46fe0656b368 req-694da1a6-400f-459c-afa3-4e74f124469f service nova] Enqueued Resource ID: a56c942d-9898-4d7c-9bad-6510f62bfcb9 with Priority: HIGHEST for action port [ 890.392817] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b776bd0-c07d-4db7-beb4-bf0b0360a21c with Priority: HIGHEST for action security_group_rules [ 890.392946] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b776bd0-c07d-4db7-beb4-bf0b0360a21c with Priority: HIGHEST for action security_group_members [ 890.396026] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a56c942d-9898-4d7c-9bad-6510f62bfcb9 with Priority: HIGHEST for action port [ 890.396026] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3b776bd0-c07d-4db7-beb4-bf0b0360a21c taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.396026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3b776bd0-c07d-4db7-beb4-bf0b0360a21c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.396026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3b776bd0-c07d-4db7-beb4-bf0b0360a21c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.396026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3b776bd0-c07d-4db7-beb4-bf0b0360a21c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.396026] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3b776bd0-c07d-4db7-beb4-bf0b0360a21c',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.396026] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b776bd0-c07d-4db7-beb4-bf0b0360a21c taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.396026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b776bd0-c07d-4db7-beb4-bf0b0360a21c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.396026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b776bd0-c07d-4db7-beb4-bf0b0360a21c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.396026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b776bd0-c07d-4db7-beb4-bf0b0360a21c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.396026] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.396026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.396703] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.396703] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.396703] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.396703] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3b776bd0-c07d-4db7-beb4-bf0b0360a21c',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.397704] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-a56c942d-9898-4d7c-9bad-6510f62bfcb9 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.397704] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a56c942d-9898-4d7c-9bad-6510f62bfcb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.397825] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a56c942d-9898-4d7c-9bad-6510f62bfcb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.397916] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a56c942d-9898-4d7c-9bad-6510f62bfcb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.397992] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a56c942d-9898-4d7c-9bad-6510f62bfcb9',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.400327] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56238df1-04a7-4a59-9d0f-ea911fb29f15 in Status: IN_PROGRESS for 2s [ 890.682550] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b in Status: SUCCESS [ 890.682819] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.683042] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.683368] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.686895] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.687069] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.687144] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.687352] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.687568] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.687568] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.687770] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.732885] env[70392]: INFO networking_nsxv3.common.synchronization [req-ac74cc96-4ce2-471d-bcb1-30a97b206088 req-d65a2702-0f3c-45b6-a507-09268f34048a tempest-ServersAdminTestJSON-721710769 tempest-ServersAdminTestJSON-721710769-project-member] Enqueued Resource ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 with Priority: HIGHEST for action security_group_members [ 890.734375] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 with Priority: HIGHEST for action security_group_members [ 890.734689] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-f54639a3-c11e-4833-b47a-e0b477c46dd5 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.734861] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.734985] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.735286] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.735469] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.735580] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.735651] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.735857] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.735984] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.736106] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f54639a3-c11e-4833-b47a-e0b477c46dd5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.901566] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3b776bd0-c07d-4db7-beb4-bf0b0360a21c',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.902704] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b776bd0-c07d-4db7-beb4-bf0b0360a21c taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.902860] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b776bd0-c07d-4db7-beb4-bf0b0360a21c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.903193] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a56c942d-9898-4d7c-9bad-6510f62bfcb9 with status ACTIVE [ 890.903357] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.903479] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.903532] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.903716] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.903844] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.903975] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.904088] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.904168] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.906233] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.906233] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.906511] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.906624] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.906767] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.906923] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.909463] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.909463] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a56c942d-9898-4d7c-9bad-6510f62bfcb9 is going to be updated. [ 890.945820] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.945820] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.945820] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.945820] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.945820] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.945820] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a56c942d-9898-4d7c-9bad-6510f62bfcb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.190561] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.190784] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.190962] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.191214] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.191424] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.191531] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.191594] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.191749] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.191833] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.191952] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.192158] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.192950] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.192950] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.192950] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.192950] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.192950] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.192950] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.192950] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.192950] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.194038] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.194038] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.238746] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f54639a3-c11e-4833-b47a-e0b477c46dd5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.295663] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-880 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.295862] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-880" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.296091] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-880" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.296373] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-880" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.296639] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.296800] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.296925] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.297347] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.297508] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.297747] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 891.297855] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 891.297972] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 891.298111] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 891.298219] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 891.298331] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 891.298467] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 891.323893] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 891.324115] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 891.324295] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 891.324519] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-880" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.325081] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-8c718ab2-95d7-4f54-9f44-2fc85623af96 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.325299] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-8c718ab2-95d7-4f54-9f44-2fc85623af96" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.325440] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-8c718ab2-95d7-4f54-9f44-2fc85623af96" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.325818] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-8c718ab2-95d7-4f54-9f44-2fc85623af96" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.326066] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c718ab2-95d7-4f54-9f44-2fc85623af96',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.404248] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3b776bd0-c07d-4db7-beb4-bf0b0360a21c',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.434196] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fc49f827-a914-4b77-820c-bb2bf63c8bc7 in Status: SUCCESS [ 891.434413] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fc49f827-a914-4b77-820c-bb2bf63c8bc7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.696590] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b: rpc.has_security_group_logging(os_id): False [ 891.715295] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.715441] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.718196] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.718196] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.718196] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.718196] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.718196] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.718196] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.718196] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.718196] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.718196] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.718196] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.718196] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.718196] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.718196] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.718196] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.718795] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.718795] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.718795] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.718795] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.718795] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b is going to be created. [ 891.741181] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f54639a3-c11e-4833-b47a-e0b477c46dd5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.913839] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.915053] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.915053] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.915053] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.915053] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.916372] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.916596] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.916938] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.917153] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.917337] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.917494] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 8c718ab2-95d7-4f54-9f44-2fc85623af96 not found, creating... [ 891.917756] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.917907] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.918221] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.918324] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.918461] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.918913] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.919088] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.919176] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.919338] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.919529] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.919633] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 8c718ab2-95d7-4f54-9f44-2fc85623af96 is going to be created. [ 891.921113] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.921284] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.921376] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.921489] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.921574] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.921652] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b776bd0-c07d-4db7-beb4-bf0b0360a21c is going to be created. [ 891.947537] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b in Status: IN_PROGRESS for 2s [ 891.952328] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.952543] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.952672] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.953022] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.954362] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.954362] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-8c718ab2-95d7-4f54-9f44-2fc85623af96" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.968202] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.968202] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.968202] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.968202] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.968202] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.988581] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b776bd0-c07d-4db7-beb4-bf0b0360a21c in Status: UNINITIALIZED for 2s [ 892.248451] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.248823] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.249334] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.250033] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.250033] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.250033] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 is going to be updated. [ 892.297063] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.297212] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.297212] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.297441] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.297555] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.310513] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 in Status: IN_PROGRESS for 2s [ 892.414919] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56238df1-04a7-4a59-9d0f-ea911fb29f15 in Status: SUCCESS [ 892.415190] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56238df1-04a7-4a59-9d0f-ea911fb29f15 deletion is rescheduled due to dependency. [ 892.415366] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56238df1-04a7-4a59-9d0f-ea911fb29f15" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.729725] env[70392]: INFO networking_nsxv3.common.synchronization [req-ac74cc96-4ce2-471d-bcb1-30a97b206088 req-eec4723d-3752-42af-a8a5-e2dd87a6b892 service nova] Enqueued Resource ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 with Priority: HIGHEST for action security_group_rules [ 892.729725] env[70392]: INFO networking_nsxv3.common.synchronization [req-ac74cc96-4ce2-471d-bcb1-30a97b206088 req-eec4723d-3752-42af-a8a5-e2dd87a6b892 service nova] Enqueued Resource ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 with Priority: HIGHEST for action security_group_members [ 892.729725] env[70392]: INFO networking_nsxv3.common.synchronization [req-ac74cc96-4ce2-471d-bcb1-30a97b206088 req-eec4723d-3752-42af-a8a5-e2dd87a6b892 service nova] Enqueued Resource ID: 8c718ab2-95d7-4f54-9f44-2fc85623af96 with Priority: HIGHEST for action port [ 892.729725] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 with Priority: HIGHEST for action security_group_rules [ 892.729725] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 with Priority: HIGHEST for action security_group_members [ 892.729725] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c718ab2-95d7-4f54-9f44-2fc85623af96 with Priority: HIGHEST for action port [ 892.732855] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f54639a3-c11e-4833-b47a-e0b477c46dd5 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.732855] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.732855] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.732855] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.732855] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f54639a3-c11e-4833-b47a-e0b477c46dd5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.733724] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-f54639a3-c11e-4833-b47a-e0b477c46dd5 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.734388] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.734388] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-8c718ab2-95d7-4f54-9f44-2fc85623af96 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.734388] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8c718ab2-95d7-4f54-9f44-2fc85623af96" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.734388] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8c718ab2-95d7-4f54-9f44-2fc85623af96" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.734644] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8c718ab2-95d7-4f54-9f44-2fc85623af96" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.734644] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c718ab2-95d7-4f54-9f44-2fc85623af96',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.237745] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-f54639a3-c11e-4833-b47a-e0b477c46dd5 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.237880] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.242776] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8c718ab2-95d7-4f54-9f44-2fc85623af96 with status ACTIVE [ 893.242776] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.242776] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.242776] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.242776] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.242776] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.242776] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.242776] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.243149] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.244344] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.244444] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.244667] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.244772] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.244834] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.245081] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.245141] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.245473] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8c718ab2-95d7-4f54-9f44-2fc85623af96 is going to be updated. [ 893.268589] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.268589] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.269613] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.269613] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.269613] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.269613] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8c718ab2-95d7-4f54-9f44-2fc85623af96" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.962152] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b in Status: SUCCESS [ 893.962388] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.000429] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b776bd0-c07d-4db7-beb4-bf0b0360a21c in Status: SUCCESS [ 894.000429] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b776bd0-c07d-4db7-beb4-bf0b0360a21c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.000429] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b776bd0-c07d-4db7-beb4-bf0b0360a21c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.000429] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b776bd0-c07d-4db7-beb4-bf0b0360a21c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.000429] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.000429] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.000429] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.000429] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.000429] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.000429] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b776bd0-c07d-4db7-beb4-bf0b0360a21c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.000429] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3b776bd0-c07d-4db7-beb4-bf0b0360a21c',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.325041] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 in Status: SUCCESS [ 894.325041] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.325041] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.325041] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.325041] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.325041] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.325041] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.325041] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.325041] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.325041] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f54639a3-c11e-4833-b47a-e0b477c46dd5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.501550] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3b776bd0-c07d-4db7-beb4-bf0b0360a21c',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.549441] env[70392]: INFO networking_nsxv3.common.synchronization [req-8c71bf87-afd2-41ec-874e-7c3ed1529e5d req-3ea88eb7-a877-4dc3-9ddb-a32b5c8d1d4d tempest-ImagesTestJSON-499820929 tempest-ImagesTestJSON-499820929-project-member] Enqueued Resource ID: bca01ddc-73d5-4856-bbff-aefad642492a with Priority: HIGHEST for action security_group_members [ 894.549441] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bca01ddc-73d5-4856-bbff-aefad642492a with Priority: HIGHEST for action security_group_members [ 894.549441] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-bca01ddc-73d5-4856-bbff-aefad642492a taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.549441] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.549914] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.550293] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.550593] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.550826] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.551122] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.551408] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.551588] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.551790] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bca01ddc-73d5-4856-bbff-aefad642492a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.828506] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f54639a3-c11e-4833-b47a-e0b477c46dd5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.004321] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3b776bd0-c07d-4db7-beb4-bf0b0360a21c: rpc.has_security_group_logging(os_id): False [ 895.030119] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.031043] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.031043] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.031043] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.031043] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.031318] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.031449] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.031544] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.031925] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.031925] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.032298] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3b776bd0-c07d-4db7-beb4-bf0b0360a21c is going to be created. [ 895.054940] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.055182] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.055182] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.055824] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.089367] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.089778] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.089948] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.090059] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.090338] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.090456] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.090616] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bca01ddc-73d5-4856-bbff-aefad642492a is going to be updated. [ 895.132244] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.132244] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.132244] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.132244] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.132244] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.154490] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3b776bd0-c07d-4db7-beb4-bf0b0360a21c in Status: IN_PROGRESS for 2s [ 895.168102] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.168416] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.168416] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.168718] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.168934] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.183364] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bca01ddc-73d5-4856-bbff-aefad642492a in Status: IN_PROGRESS for 2s [ 895.330680] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f54639a3-c11e-4833-b47a-e0b477c46dd5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.842039] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.842039] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.842039] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.842039] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.842039] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.842039] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 is going to be updated. [ 895.878836] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.879039] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.879109] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.879304] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.879448] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.893614] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 in Status: IN_PROGRESS for 2s [ 895.918085] env[70392]: INFO networking_nsxv3.common.synchronization [req-79c6e0c2-7518-4fb9-903f-105e6b577d01 req-eb3a2566-84bd-4f27-acd4-b4f26bb22cf1 tempest-ServersNegativeTestMultiTenantJSON-1712723732 tempest-ServersNegativeTestMultiTenantJSON-1712723732-project-member] Enqueued Resource ID: 1c75159c-a2db-4a16-8163-159ea78c9c84 with Priority: HIGHEST for action security_group_members [ 895.918662] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c75159c-a2db-4a16-8163-159ea78c9c84 with Priority: HIGHEST for action security_group_members [ 895.919278] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c75159c-a2db-4a16-8163-159ea78c9c84 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.919403] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c75159c-a2db-4a16-8163-159ea78c9c84" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.919490] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c75159c-a2db-4a16-8163-159ea78c9c84" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.919751] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c75159c-a2db-4a16-8163-159ea78c9c84" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.919905] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.920012] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.920084] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.920235] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.920313] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.920401] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c75159c-a2db-4a16-8163-159ea78c9c84',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.427997] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.427997] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.427997] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.427997] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.427997] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.427997] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.427997] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.427997] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.427997] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.427997] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.428691] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c75159c-a2db-4a16-8163-159ea78c9c84 already deleted. [ 896.428691] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c75159c-a2db-4a16-8163-159ea78c9c84" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.524670] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-759 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.524876] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-759" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.524994] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-759" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.525350] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-759" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.525616] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.525778] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.525898] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.526127] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.526279] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.526495] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 896.526611] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 896.526726] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 896.526932] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 896.527025] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 896.527060] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 896.527197] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 896.554862] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 896.555135] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 896.555309] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 896.555534] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-759" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.556058] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-9d480534-1b01-4f9e-84da-73af7694ab15 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.556338] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-9d480534-1b01-4f9e-84da-73af7694ab15" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.556531] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-9d480534-1b01-4f9e-84da-73af7694ab15" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.556888] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-9d480534-1b01-4f9e-84da-73af7694ab15" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.557071] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d480534-1b01-4f9e-84da-73af7694ab15',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.800926] env[70392]: INFO networking_nsxv3.common.synchronization [req-8f9331d3-e944-4fff-bdcf-4ff980b8f807 req-57df8c7a-78b9-4bee-a4ea-84ac444af42d tempest-ImagesOneServerNegativeTestJSON-1691594958 tempest-ImagesOneServerNegativeTestJSON-1691594958-project-member] Enqueued Resource ID: dbeb3b19-0a8e-4685-84e0-239c82418063 with Priority: HIGHEST for action security_group_members [ 896.801588] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbeb3b19-0a8e-4685-84e0-239c82418063 with Priority: HIGHEST for action security_group_members [ 896.801908] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbeb3b19-0a8e-4685-84e0-239c82418063 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.802049] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.802114] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.802316] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.802473] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.802568] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.802731] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.802793] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.803148] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.803148] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbeb3b19-0a8e-4685-84e0-239c82418063',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.061637] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.061891] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.062104] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.062381] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.062565] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.062732] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 9d480534-1b01-4f9e-84da-73af7694ab15 not found, creating... [ 897.063030] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.063219] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.063371] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.063625] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.063823] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.064207] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.064378] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.064500] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.064716] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.064864] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.065033] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 9d480534-1b01-4f9e-84da-73af7694ab15 is going to be created. [ 897.091421] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.091421] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.091421] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.091421] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.092222] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.092222] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-9d480534-1b01-4f9e-84da-73af7694ab15" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.169539] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3b776bd0-c07d-4db7-beb4-bf0b0360a21c in Status: SUCCESS [ 897.169884] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3b776bd0-c07d-4db7-beb4-bf0b0360a21c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.196084] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bca01ddc-73d5-4856-bbff-aefad642492a in Status: SUCCESS [ 897.196230] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bca01ddc-73d5-4856-bbff-aefad642492a deletion is rescheduled due to dependency. [ 897.196339] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.306082] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.306269] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.306348] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.306578] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.306673] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.306944] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.307042] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.307083] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.307217] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.307293] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.307384] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbeb3b19-0a8e-4685-84e0-239c82418063 is going to be updated. [ 897.340647] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.340844] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.340898] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.341151] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.341307] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.352467] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbeb3b19-0a8e-4685-84e0-239c82418063 in Status: IN_PROGRESS for 2s [ 897.907737] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 in Status: SUCCESS [ 897.907737] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.907737] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.907737] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.907737] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.907737] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.907737] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.907737] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.907737] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.907737] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.907737] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f54639a3-c11e-4833-b47a-e0b477c46dd5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.937588] env[70392]: INFO networking_nsxv3.common.synchronization [req-79c6e0c2-7518-4fb9-903f-105e6b577d01 req-99fd9ab7-6960-4d65-afbc-c818c8f2aef3 service nova] Enqueued Resource ID: 1c75159c-a2db-4a16-8163-159ea78c9c84 with Priority: HIGHEST for action security_group_rules [ 897.937588] env[70392]: INFO networking_nsxv3.common.synchronization [req-79c6e0c2-7518-4fb9-903f-105e6b577d01 req-99fd9ab7-6960-4d65-afbc-c818c8f2aef3 service nova] Enqueued Resource ID: 1c75159c-a2db-4a16-8163-159ea78c9c84 with Priority: HIGHEST for action security_group_members [ 897.937588] env[70392]: INFO networking_nsxv3.common.synchronization [req-79c6e0c2-7518-4fb9-903f-105e6b577d01 req-99fd9ab7-6960-4d65-afbc-c818c8f2aef3 service nova] Enqueued Resource ID: 9d480534-1b01-4f9e-84da-73af7694ab15 with Priority: HIGHEST for action port [ 897.937588] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c75159c-a2db-4a16-8163-159ea78c9c84 with Priority: HIGHEST for action security_group_rules [ 897.937588] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c75159c-a2db-4a16-8163-159ea78c9c84 with Priority: HIGHEST for action security_group_members [ 897.937588] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d480534-1b01-4f9e-84da-73af7694ab15 with Priority: HIGHEST for action port [ 897.937588] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1c75159c-a2db-4a16-8163-159ea78c9c84 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.938055] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1c75159c-a2db-4a16-8163-159ea78c9c84" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.938246] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1c75159c-a2db-4a16-8163-159ea78c9c84" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.938583] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1c75159c-a2db-4a16-8163-159ea78c9c84" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.938837] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1c75159c-a2db-4a16-8163-159ea78c9c84',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.940047] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c75159c-a2db-4a16-8163-159ea78c9c84 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.940389] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c75159c-a2db-4a16-8163-159ea78c9c84" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.940579] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c75159c-a2db-4a16-8163-159ea78c9c84" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.941043] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c75159c-a2db-4a16-8163-159ea78c9c84" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.941333] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.942828] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.942828] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.942828] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.942828] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.942828] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c75159c-a2db-4a16-8163-159ea78c9c84',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.946236] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d480534-1b01-4f9e-84da-73af7694ab15 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.946236] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d480534-1b01-4f9e-84da-73af7694ab15" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.946236] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d480534-1b01-4f9e-84da-73af7694ab15" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.946236] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d480534-1b01-4f9e-84da-73af7694ab15" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.946236] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d480534-1b01-4f9e-84da-73af7694ab15',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.412766] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-f54639a3-c11e-4833-b47a-e0b477c46dd5 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.412766] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.412766] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.412766] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.412766] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.412766] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.412766] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.412766] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.412766] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.412766] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.412766] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-f54639a3-c11e-4833-b47a-e0b477c46dd5 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.412766] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.412766] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.412766] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.412766] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.412766] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.413475] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.413475] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.413475] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.413475] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.413475] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f54639a3-c11e-4833-b47a-e0b477c46dd5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.450026] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1c75159c-a2db-4a16-8163-159ea78c9c84',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.450026] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c75159c-a2db-4a16-8163-159ea78c9c84 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.450026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c75159c-a2db-4a16-8163-159ea78c9c84" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.450026] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9d480534-1b01-4f9e-84da-73af7694ab15 with status ACTIVE [ 898.450026] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.450026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.450026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.450026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.450026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.450026] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.450026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.450026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.450026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.450026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.451087] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.451087] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.451087] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.451087] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.451087] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.451345] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9d480534-1b01-4f9e-84da-73af7694ab15 is going to be updated. [ 898.481257] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.481257] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.481257] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.481257] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.481257] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.481257] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d480534-1b01-4f9e-84da-73af7694ab15" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.507209] env[70392]: INFO networking_nsxv3.common.synchronization [req-a7ec57c5-2f7e-4712-b996-433ba886ef29 req-2afc1ad8-b389-4634-8178-29f0f5a09bf9 tempest-ServersWithSpecificFlavorTestJSON-1944551370 tempest-ServersWithSpecificFlavorTestJSON-1944551370-project-member] Enqueued Resource ID: 7f78f149-d978-4089-8aa8-d480e7d7bb61 with Priority: HIGHEST for action security_group_members [ 898.507209] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f78f149-d978-4089-8aa8-d480e7d7bb61 with Priority: HIGHEST for action security_group_members [ 898.507209] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f78f149-d978-4089-8aa8-d480e7d7bb61 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.507209] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f78f149-d978-4089-8aa8-d480e7d7bb61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.507209] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f78f149-d978-4089-8aa8-d480e7d7bb61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.507209] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f78f149-d978-4089-8aa8-d480e7d7bb61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.507209] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.507209] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.507209] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.507209] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.507209] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.507986] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f78f149-d978-4089-8aa8-d480e7d7bb61',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.915784] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f54639a3-c11e-4833-b47a-e0b477c46dd5: rpc.has_security_group_logging(os_id): False [ 898.946976] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.947950] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.948100] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.948347] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.948467] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.948691] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.948783] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.948850] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.949080] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.949222] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.949442] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.949549] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.949611] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.949817] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.949945] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.950197] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.950316] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.950401] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.950652] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.950717] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.950806] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 is going to be updated. [ 898.955132] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1c75159c-a2db-4a16-8163-159ea78c9c84',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.969411] env[70392]: INFO networking_nsxv3.common.synchronization [req-a805bd9f-ca92-4401-8ff6-0ebf2bccd9f6 req-e3eeebc4-9bb5-4588-b88f-ba26223af0e5 tempest-VolumesAdminNegativeTest-687729453 tempest-VolumesAdminNegativeTest-687729453-project-member] Enqueued Resource ID: fc49f827-a914-4b77-820c-bb2bf63c8bc7 with Priority: HIGHEST for action security_group_members [ 898.969411] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc49f827-a914-4b77-820c-bb2bf63c8bc7 with Priority: HIGHEST for action security_group_members [ 898.969411] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc49f827-a914-4b77-820c-bb2bf63c8bc7 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.969411] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc49f827-a914-4b77-820c-bb2bf63c8bc7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.969411] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc49f827-a914-4b77-820c-bb2bf63c8bc7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.969411] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc49f827-a914-4b77-820c-bb2bf63c8bc7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.969786] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.969786] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.969786] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.970058] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.970298] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.970298] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc49f827-a914-4b77-820c-bb2bf63c8bc7',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.010960] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.010960] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.011421] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.011421] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.011421] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.011690] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.011974] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.011974] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.011974] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.012290] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.012290] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f78f149-d978-4089-8aa8-d480e7d7bb61 is going to be updated. [ 899.036957] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.036957] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.036957] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.036957] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.036957] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.090356] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 in Status: IN_PROGRESS for 2s [ 899.108952] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.109215] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.109295] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.109502] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.109646] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.130594] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f78f149-d978-4089-8aa8-d480e7d7bb61 in Status: IN_PROGRESS for 2s [ 899.365672] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbeb3b19-0a8e-4685-84e0-239c82418063 in Status: SUCCESS [ 899.366110] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbeb3b19-0a8e-4685-84e0-239c82418063 deletion is rescheduled due to dependency. [ 899.366278] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.459100] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.462236] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.462236] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.462236] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.462236] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.462236] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c75159c-a2db-4a16-8163-159ea78c9c84 is going to be created. [ 899.476235] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.476235] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.476235] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.476235] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.476235] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.476235] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.476235] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.476235] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.476235] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.476235] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.476235] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc49f827-a914-4b77-820c-bb2bf63c8bc7 is going to be updated. [ 899.487110] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.489029] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.489029] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.489029] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.489029] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.498128] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c75159c-a2db-4a16-8163-159ea78c9c84 in Status: UNINITIALIZED for 2s [ 899.508184] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.510332] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.510332] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.510332] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.510332] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.519377] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc49f827-a914-4b77-820c-bb2bf63c8bc7 in Status: IN_PROGRESS for 2s [ 900.358750] env[70392]: INFO networking_nsxv3.common.synchronization [None req-37988b39-cbd0-4cb6-9a1c-86d8aa918728 tempest-AttachInterfacesTestJSON-2046649887 tempest-AttachInterfacesTestJSON-2046649887-project-member] Enqueued Resource ID: 40ebe9d4-d512-4967-99a6-0a7cf11dc1cd with Priority: HIGHEST for action security_group_rules [ 900.359553] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40ebe9d4-d512-4967-99a6-0a7cf11dc1cd with Priority: HIGHEST for action security_group_rules [ 900.360138] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40ebe9d4-d512-4967-99a6-0a7cf11dc1cd taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.360138] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40ebe9d4-d512-4967-99a6-0a7cf11dc1cd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.360306] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40ebe9d4-d512-4967-99a6-0a7cf11dc1cd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.360500] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40ebe9d4-d512-4967-99a6-0a7cf11dc1cd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.360542] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40ebe9d4-d512-4967-99a6-0a7cf11dc1cd',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.573212] env[70392]: INFO networking_nsxv3.common.synchronization [req-245e20ea-e93a-4599-ba65-cf99113670a3 req-af895f7c-3cc4-4203-b4fb-3def03b1facc tempest-SecurityGroupsTestJSON-87195518 tempest-SecurityGroupsTestJSON-87195518-project-member] Enqueued Resource ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b with Priority: HIGHEST for action security_group_members [ 900.573545] env[70392]: INFO networking_nsxv3.common.synchronization [req-245e20ea-e93a-4599-ba65-cf99113670a3 req-af895f7c-3cc4-4203-b4fb-3def03b1facc tempest-SecurityGroupsTestJSON-87195518 tempest-SecurityGroupsTestJSON-87195518-project-member] Enqueued Resource ID: fc6010b2-a356-4e5d-898a-bf9ca32456ec with Priority: HIGHEST for action security_group_members [ 900.574295] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b with Priority: HIGHEST for action security_group_members [ 900.578252] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc6010b2-a356-4e5d-898a-bf9ca32456ec with Priority: HIGHEST for action security_group_members [ 900.578252] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.578252] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.578252] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.578252] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.578252] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.578252] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.578252] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.578252] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.578252] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.578252] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.578640] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc6010b2-a356-4e5d-898a-bf9ca32456ec taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.578640] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc6010b2-a356-4e5d-898a-bf9ca32456ec" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.578640] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc6010b2-a356-4e5d-898a-bf9ca32456ec" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.578865] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc6010b2-a356-4e5d-898a-bf9ca32456ec" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.579010] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.579090] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.579129] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.579264] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.579332] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.579414] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc6010b2-a356-4e5d-898a-bf9ca32456ec',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.590352] env[70392]: INFO networking_nsxv3.common.synchronization [None req-c8a2b82f-f586-4d8b-bbb0-8ed29390adec tempest-AttachInterfacesTestJSON-2046649887 tempest-AttachInterfacesTestJSON-2046649887-project-member] Enqueued Resource ID: 40ebe9d4-d512-4967-99a6-0a7cf11dc1cd with Priority: HIGHEST for action security_group_rules [ 900.591458] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40ebe9d4-d512-4967-99a6-0a7cf11dc1cd with Priority: HIGHEST for action security_group_rules [ 900.591782] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40ebe9d4-d512-4967-99a6-0a7cf11dc1cd taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.591889] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40ebe9d4-d512-4967-99a6-0a7cf11dc1cd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.645929] env[70392]: INFO networking_nsxv3.common.synchronization [req-245e20ea-e93a-4599-ba65-cf99113670a3 req-af895f7c-3cc4-4203-b4fb-3def03b1facc tempest-SecurityGroupsTestJSON-87195518 tempest-SecurityGroupsTestJSON-87195518-project-member] Enqueued Resource ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b with Priority: HIGHEST for action security_group_rules [ 900.646148] env[70392]: INFO networking_nsxv3.common.synchronization [req-245e20ea-e93a-4599-ba65-cf99113670a3 req-af895f7c-3cc4-4203-b4fb-3def03b1facc tempest-SecurityGroupsTestJSON-87195518 tempest-SecurityGroupsTestJSON-87195518-project-member] Enqueued Resource ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b with Priority: HIGHEST for action security_group_members [ 900.646293] env[70392]: INFO networking_nsxv3.common.synchronization [req-245e20ea-e93a-4599-ba65-cf99113670a3 req-af895f7c-3cc4-4203-b4fb-3def03b1facc tempest-SecurityGroupsTestJSON-87195518 tempest-SecurityGroupsTestJSON-87195518-project-member] Enqueued Resource ID: fc6010b2-a356-4e5d-898a-bf9ca32456ec with Priority: HIGHEST for action security_group_rules [ 900.646422] env[70392]: INFO networking_nsxv3.common.synchronization [req-245e20ea-e93a-4599-ba65-cf99113670a3 req-af895f7c-3cc4-4203-b4fb-3def03b1facc tempest-SecurityGroupsTestJSON-87195518 tempest-SecurityGroupsTestJSON-87195518-project-member] Enqueued Resource ID: fc6010b2-a356-4e5d-898a-bf9ca32456ec with Priority: HIGHEST for action security_group_members [ 900.646554] env[70392]: INFO networking_nsxv3.common.synchronization [req-245e20ea-e93a-4599-ba65-cf99113670a3 req-af895f7c-3cc4-4203-b4fb-3def03b1facc tempest-SecurityGroupsTestJSON-87195518 tempest-SecurityGroupsTestJSON-87195518-project-member] Enqueued Resource ID: 16e680e5-61e3-4415-ac6b-add4a154117f with Priority: HIGHEST for action port [ 900.647108] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b with Priority: HIGHEST for action security_group_rules [ 900.647330] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc6010b2-a356-4e5d-898a-bf9ca32456ec with Priority: HIGHEST for action security_group_rules [ 900.647411] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16e680e5-61e3-4415-ac6b-add4a154117f with Priority: HIGHEST for action port [ 900.647535] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b with Priority: HIGHEST for action security_group_members [ 900.647718] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc6010b2-a356-4e5d-898a-bf9ca32456ec with Priority: HIGHEST for action security_group_members [ 900.647990] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.648173] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.648266] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.648503] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.648619] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.649623] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fc6010b2-a356-4e5d-898a-bf9ca32456ec taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.649780] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fc6010b2-a356-4e5d-898a-bf9ca32456ec" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.650009] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fc6010b2-a356-4e5d-898a-bf9ca32456ec" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.650167] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fc6010b2-a356-4e5d-898a-bf9ca32456ec" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.650272] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fc6010b2-a356-4e5d-898a-bf9ca32456ec',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.651133] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-16e680e5-61e3-4415-ac6b-add4a154117f taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.651370] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-16e680e5-61e3-4415-ac6b-add4a154117f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.651470] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-16e680e5-61e3-4415-ac6b-add4a154117f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.651661] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-16e680e5-61e3-4415-ac6b-add4a154117f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.651763] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16e680e5-61e3-4415-ac6b-add4a154117f',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.652518] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.652639] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.652863] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc6010b2-a356-4e5d-898a-bf9ca32456ec taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.652978] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc6010b2-a356-4e5d-898a-bf9ca32456ec" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.886609] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.887070] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.887244] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.888119] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.888376] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.888648] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40ebe9d4-d512-4967-99a6-0a7cf11dc1cd already deleted. [ 900.889223] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40ebe9d4-d512-4967-99a6-0a7cf11dc1cd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.889613] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40ebe9d4-d512-4967-99a6-0a7cf11dc1cd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.890011] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40ebe9d4-d512-4967-99a6-0a7cf11dc1cd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.890192] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40ebe9d4-d512-4967-99a6-0a7cf11dc1cd',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.081238] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.082461] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fc6010b2-a356-4e5d-898a-bf9ca32456ec',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.106775] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 in Status: SUCCESS [ 901.107021] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.142131] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f78f149-d978-4089-8aa8-d480e7d7bb61 in Status: SUCCESS [ 901.142346] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f78f149-d978-4089-8aa8-d480e7d7bb61 deletion is rescheduled due to dependency. [ 901.142476] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f78f149-d978-4089-8aa8-d480e7d7bb61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.158855] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.158855] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.158855] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc6010b2-a356-4e5d-898a-bf9ca32456ec taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.158855] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc6010b2-a356-4e5d-898a-bf9ca32456ec" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.158855] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 16e680e5-61e3-4415-ac6b-add4a154117f with status ACTIVE [ 901.158855] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.158855] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.158855] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.158855] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.158855] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.158855] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.158855] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.158855] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.158855] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.158855] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.159775] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.159775] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.159775] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.159775] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.159775] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.159775] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 16e680e5-61e3-4415-ac6b-add4a154117f is going to be updated. [ 901.181238] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.181425] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.181501] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.181718] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.181863] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.182265] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-16e680e5-61e3-4415-ac6b-add4a154117f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.375866] env[70392]: INFO networking_nsxv3.common.synchronization [req-9a8c56be-8ffc-47f1-b517-1418fd68e97f req-5ffb6a2b-9835-43f6-91ed-b434f3950b71 tempest-SecurityGroupsTestJSON-87195518 tempest-SecurityGroupsTestJSON-87195518-project-member] Enqueued Resource ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b with Priority: HIGHEST for action security_group_members [ 901.376119] env[70392]: INFO networking_nsxv3.common.synchronization [req-9a8c56be-8ffc-47f1-b517-1418fd68e97f req-5ffb6a2b-9835-43f6-91ed-b434f3950b71 tempest-SecurityGroupsTestJSON-87195518 tempest-SecurityGroupsTestJSON-87195518-project-member] Enqueued Resource ID: fc6010b2-a356-4e5d-898a-bf9ca32456ec with Priority: HIGHEST for action security_group_members [ 901.376440] env[70392]: INFO networking_nsxv3.common.synchronization [req-9a8c56be-8ffc-47f1-b517-1418fd68e97f req-5ffb6a2b-9835-43f6-91ed-b434f3950b71 tempest-SecurityGroupsTestJSON-87195518 tempest-SecurityGroupsTestJSON-87195518-project-member] Enqueued Resource ID: 438fa731-ac4f-4636-ae4b-8e30973002cd with Priority: HIGHEST for action security_group_members [ 901.376745] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b with Priority: HIGHEST for action security_group_members [ 901.378579] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc6010b2-a356-4e5d-898a-bf9ca32456ec with Priority: HIGHEST for action security_group_members [ 901.378579] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 438fa731-ac4f-4636-ae4b-8e30973002cd with Priority: HIGHEST for action security_group_members [ 901.378579] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.378579] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.378579] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc6010b2-a356-4e5d-898a-bf9ca32456ec taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.378579] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc6010b2-a356-4e5d-898a-bf9ca32456ec" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.378579] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-438fa731-ac4f-4636-ae4b-8e30973002cd taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.378579] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-438fa731-ac4f-4636-ae4b-8e30973002cd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.378579] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-438fa731-ac4f-4636-ae4b-8e30973002cd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.378579] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-438fa731-ac4f-4636-ae4b-8e30973002cd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.378579] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.378579] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.379309] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.379309] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.379309] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.379309] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('438fa731-ac4f-4636-ae4b-8e30973002cd',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.438828] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.439072] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.439146] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.439366] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.439578] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.439578] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40ebe9d4-d512-4967-99a6-0a7cf11dc1cd already deleted. [ 901.439697] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40ebe9d4-d512-4967-99a6-0a7cf11dc1cd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.464168] env[70392]: INFO networking_nsxv3.common.synchronization [req-9a8c56be-8ffc-47f1-b517-1418fd68e97f req-5ffb6a2b-9835-43f6-91ed-b434f3950b71 tempest-SecurityGroupsTestJSON-87195518 tempest-SecurityGroupsTestJSON-87195518-project-member] Enqueued Resource ID: 438fa731-ac4f-4636-ae4b-8e30973002cd with Priority: HIGHEST for action security_group_rules [ 901.464168] env[70392]: INFO networking_nsxv3.common.synchronization [req-9a8c56be-8ffc-47f1-b517-1418fd68e97f req-5ffb6a2b-9835-43f6-91ed-b434f3950b71 tempest-SecurityGroupsTestJSON-87195518 tempest-SecurityGroupsTestJSON-87195518-project-member] Enqueued Resource ID: 438fa731-ac4f-4636-ae4b-8e30973002cd with Priority: HIGHEST for action security_group_members [ 901.464168] env[70392]: INFO networking_nsxv3.common.synchronization [req-9a8c56be-8ffc-47f1-b517-1418fd68e97f req-5ffb6a2b-9835-43f6-91ed-b434f3950b71 tempest-SecurityGroupsTestJSON-87195518 tempest-SecurityGroupsTestJSON-87195518-project-member] Enqueued Resource ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b with Priority: HIGHEST for action security_group_rules [ 901.464168] env[70392]: INFO networking_nsxv3.common.synchronization [req-9a8c56be-8ffc-47f1-b517-1418fd68e97f req-5ffb6a2b-9835-43f6-91ed-b434f3950b71 tempest-SecurityGroupsTestJSON-87195518 tempest-SecurityGroupsTestJSON-87195518-project-member] Enqueued Resource ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b with Priority: HIGHEST for action security_group_members [ 901.464168] env[70392]: INFO networking_nsxv3.common.synchronization [req-9a8c56be-8ffc-47f1-b517-1418fd68e97f req-5ffb6a2b-9835-43f6-91ed-b434f3950b71 tempest-SecurityGroupsTestJSON-87195518 tempest-SecurityGroupsTestJSON-87195518-project-member] Enqueued Resource ID: fc6010b2-a356-4e5d-898a-bf9ca32456ec with Priority: HIGHEST for action security_group_rules [ 901.464168] env[70392]: INFO networking_nsxv3.common.synchronization [req-9a8c56be-8ffc-47f1-b517-1418fd68e97f req-5ffb6a2b-9835-43f6-91ed-b434f3950b71 tempest-SecurityGroupsTestJSON-87195518 tempest-SecurityGroupsTestJSON-87195518-project-member] Enqueued Resource ID: fc6010b2-a356-4e5d-898a-bf9ca32456ec with Priority: HIGHEST for action security_group_members [ 901.464168] env[70392]: INFO networking_nsxv3.common.synchronization [req-9a8c56be-8ffc-47f1-b517-1418fd68e97f req-5ffb6a2b-9835-43f6-91ed-b434f3950b71 tempest-SecurityGroupsTestJSON-87195518 tempest-SecurityGroupsTestJSON-87195518-project-member] Enqueued Resource ID: 16e680e5-61e3-4415-ac6b-add4a154117f with Priority: HIGHEST for action port [ 901.464729] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 438fa731-ac4f-4636-ae4b-8e30973002cd with Priority: HIGHEST for action security_group_rules [ 901.464788] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b with Priority: HIGHEST for action security_group_rules [ 901.464905] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc6010b2-a356-4e5d-898a-bf9ca32456ec with Priority: HIGHEST for action security_group_members [ 901.464968] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16e680e5-61e3-4415-ac6b-add4a154117f with Priority: HIGHEST for action port [ 901.466055] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc6010b2-a356-4e5d-898a-bf9ca32456ec with Priority: HIGHEST for action security_group_rules [ 901.466055] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 438fa731-ac4f-4636-ae4b-8e30973002cd with Priority: HIGHEST for action security_group_members [ 901.466055] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b with Priority: HIGHEST for action security_group_members [ 901.466055] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-438fa731-ac4f-4636-ae4b-8e30973002cd taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.466055] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-438fa731-ac4f-4636-ae4b-8e30973002cd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.466055] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-438fa731-ac4f-4636-ae4b-8e30973002cd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.466499] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-438fa731-ac4f-4636-ae4b-8e30973002cd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.466560] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('438fa731-ac4f-4636-ae4b-8e30973002cd',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.471017] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.471207] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.471555] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc6010b2-a356-4e5d-898a-bf9ca32456ec taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.471804] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc6010b2-a356-4e5d-898a-bf9ca32456ec" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.472714] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-16e680e5-61e3-4415-ac6b-add4a154117f taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.472714] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-16e680e5-61e3-4415-ac6b-add4a154117f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.472714] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-16e680e5-61e3-4415-ac6b-add4a154117f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.473414] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-16e680e5-61e3-4415-ac6b-add4a154117f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.474417] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16e680e5-61e3-4415-ac6b-add4a154117f',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.474985] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fc6010b2-a356-4e5d-898a-bf9ca32456ec taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.475171] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fc6010b2-a356-4e5d-898a-bf9ca32456ec" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.475506] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-438fa731-ac4f-4636-ae4b-8e30973002cd taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.475666] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-438fa731-ac4f-4636-ae4b-8e30973002cd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.476013] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.476193] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.509445] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c75159c-a2db-4a16-8163-159ea78c9c84 in Status: SUCCESS [ 901.509445] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c75159c-a2db-4a16-8163-159ea78c9c84" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.509987] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c75159c-a2db-4a16-8163-159ea78c9c84" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.509987] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c75159c-a2db-4a16-8163-159ea78c9c84" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.510275] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.510275] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.510408] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.510588] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.510588] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.510706] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c75159c-a2db-4a16-8163-159ea78c9c84" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.510706] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1c75159c-a2db-4a16-8163-159ea78c9c84',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.527624] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc49f827-a914-4b77-820c-bb2bf63c8bc7 in Status: SUCCESS [ 901.527758] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc49f827-a914-4b77-820c-bb2bf63c8bc7 deletion is rescheduled due to dependency. [ 901.527899] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc49f827-a914-4b77-820c-bb2bf63c8bc7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.585746] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.586756] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fc6010b2-a356-4e5d-898a-bf9ca32456ec',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.887306] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('438fa731-ac4f-4636-ae4b-8e30973002cd',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.977823] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 16e680e5-61e3-4415-ac6b-add4a154117f with status ACTIVE [ 901.978100] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.978209] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.978276] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.978495] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.978582] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.978760] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.978869] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.978904] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.979050] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.979144] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.979414] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.979569] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.979689] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.979878] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.979953] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.980060] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 16e680e5-61e3-4415-ac6b-add4a154117f is going to be updated. [ 901.981409] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-438fa731-ac4f-4636-ae4b-8e30973002cd taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.981515] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-438fa731-ac4f-4636-ae4b-8e30973002cd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.004301] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.004301] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.004301] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.004531] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.004642] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.004808] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-16e680e5-61e3-4415-ac6b-add4a154117f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.015598] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c75159c-a2db-4a16-8163-159ea78c9c84 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.015598] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c75159c-a2db-4a16-8163-159ea78c9c84" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.016053] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c75159c-a2db-4a16-8163-159ea78c9c84" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.016399] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c75159c-a2db-4a16-8163-159ea78c9c84" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.016678] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.016853] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.016960] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.022094] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.022299] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.022299] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c75159c-a2db-4a16-8163-159ea78c9c84" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.022661] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c75159c-a2db-4a16-8163-159ea78c9c84 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.022661] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c75159c-a2db-4a16-8163-159ea78c9c84" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.022661] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c75159c-a2db-4a16-8163-159ea78c9c84" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.022829] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c75159c-a2db-4a16-8163-159ea78c9c84" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.022962] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.023089] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.023144] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.023257] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.023405] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.023450] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c75159c-a2db-4a16-8163-159ea78c9c84" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.023539] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1c75159c-a2db-4a16-8163-159ea78c9c84',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.088778] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.091030] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.091030] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.091030] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.091278] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.091278] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b is going to be updated. [ 902.092647] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.092823] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.092912] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.093148] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.093268] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.093388] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc6010b2-a356-4e5d-898a-bf9ca32456ec is going to be created. [ 902.123148] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.123148] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.123354] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.123455] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.123642] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.131879] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.132045] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.132134] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.132335] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.132497] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.147136] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc6010b2-a356-4e5d-898a-bf9ca32456ec in Status: UNINITIALIZED for 2s [ 902.147994] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b in Status: IN_PROGRESS for 2s [ 902.389931] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('438fa731-ac4f-4636-ae4b-8e30973002cd',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.526606] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1c75159c-a2db-4a16-8163-159ea78c9c84: rpc.has_security_group_logging(os_id): False [ 902.551548] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.551863] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.551863] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.552051] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.552126] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.552303] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.552414] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.552452] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.552640] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.552725] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.552927] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.553081] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.553152] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.553294] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.553369] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.553660] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.553831] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.553943] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.554170] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.554270] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.554397] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1c75159c-a2db-4a16-8163-159ea78c9c84 is going to be created. [ 902.655126] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.655310] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.655372] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.655570] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.655745] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.669636] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c75159c-a2db-4a16-8163-159ea78c9c84 in Status: IN_PROGRESS for 2s [ 902.893544] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.893713] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.893788] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.894035] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.894156] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.894231] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 438fa731-ac4f-4636-ae4b-8e30973002cd is going to be created. [ 902.919619] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.919771] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.919837] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.920060] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.920226] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.931614] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 438fa731-ac4f-4636-ae4b-8e30973002cd in Status: UNINITIALIZED for 2s [ 904.159271] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc6010b2-a356-4e5d-898a-bf9ca32456ec in Status: SUCCESS [ 904.159553] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc6010b2-a356-4e5d-898a-bf9ca32456ec" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.159639] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc6010b2-a356-4e5d-898a-bf9ca32456ec" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.159859] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc6010b2-a356-4e5d-898a-bf9ca32456ec" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.160055] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.160174] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.160245] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.160421] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.160521] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.160631] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc6010b2-a356-4e5d-898a-bf9ca32456ec',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.162178] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b in Status: SUCCESS [ 904.162362] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.162515] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.162690] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.162910] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.162984] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.163035] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.164156] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.164156] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.164156] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.665133] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fc6010b2-a356-4e5d-898a-bf9ca32456ec',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.667708] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.682839] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c75159c-a2db-4a16-8163-159ea78c9c84 in Status: SUCCESS [ 904.683077] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1c75159c-a2db-4a16-8163-159ea78c9c84" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.944088] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 438fa731-ac4f-4636-ae4b-8e30973002cd in Status: SUCCESS [ 904.944475] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-438fa731-ac4f-4636-ae4b-8e30973002cd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.944639] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-438fa731-ac4f-4636-ae4b-8e30973002cd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.944937] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-438fa731-ac4f-4636-ae4b-8e30973002cd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.945062] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.945179] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.945239] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.945394] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.945489] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.945563] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('438fa731-ac4f-4636-ae4b-8e30973002cd',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.169826] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fc6010b2-a356-4e5d-898a-bf9ca32456ec',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.169826] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.448823] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('438fa731-ac4f-4636-ae4b-8e30973002cd',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.671947] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.672199] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.675107] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.675107] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.675107] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.675107] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc6010b2-a356-4e5d-898a-bf9ca32456ec is going to be updated. [ 905.675107] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.675107] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.675107] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.675107] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.675107] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.675107] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b is going to be updated. [ 905.708255] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.708444] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.708444] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.708707] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.708859] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.710506] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.710667] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.710805] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.710967] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.710967] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.723703] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b in Status: IN_PROGRESS for 2s [ 905.724775] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc6010b2-a356-4e5d-898a-bf9ca32456ec in Status: IN_PROGRESS for 2s [ 905.952960] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('438fa731-ac4f-4636-ae4b-8e30973002cd',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.455608] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.455961] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.455961] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.456124] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.456216] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.456324] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 438fa731-ac4f-4636-ae4b-8e30973002cd is going to be updated. [ 906.466724] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 906.466993] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=12 [ 906.485969] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.486143] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.486381] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.486687] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.486835] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.496124] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 438fa731-ac4f-4636-ae4b-8e30973002cd in Status: IN_PROGRESS for 2s [ 907.736880] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc6010b2-a356-4e5d-898a-bf9ca32456ec in Status: SUCCESS [ 907.737176] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc6010b2-a356-4e5d-898a-bf9ca32456ec" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.737325] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc6010b2-a356-4e5d-898a-bf9ca32456ec" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.737694] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc6010b2-a356-4e5d-898a-bf9ca32456ec" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.737920] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.738086] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.738178] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.738382] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.738500] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.738636] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc6010b2-a356-4e5d-898a-bf9ca32456ec" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.738771] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fc6010b2-a356-4e5d-898a-bf9ca32456ec',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.743017] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b in Status: SUCCESS [ 907.743017] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.743017] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc6010b2-a356-4e5d-898a-bf9ca32456ec" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.743017] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc6010b2-a356-4e5d-898a-bf9ca32456ec" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.743017] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.743017] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.743017] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.743017] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.743017] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.743017] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc6010b2-a356-4e5d-898a-bf9ca32456ec',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.744041] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.744957] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.745347] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.745499] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.745641] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.745931] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.746318] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.746318] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.746318] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.747377] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.747578] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.747797] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.747955] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.748021] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.748271] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.748271] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.751816] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.248424] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fc6010b2-a356-4e5d-898a-bf9ca32456ec',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.249515] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fc6010b2-a356-4e5d-898a-bf9ca32456ec',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.250919] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.250919] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.251133] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.506967] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 438fa731-ac4f-4636-ae4b-8e30973002cd in Status: SUCCESS [ 908.507173] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-438fa731-ac4f-4636-ae4b-8e30973002cd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.507351] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-438fa731-ac4f-4636-ae4b-8e30973002cd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.507634] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-438fa731-ac4f-4636-ae4b-8e30973002cd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.507875] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.508031] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.508121] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.508315] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.508420] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.508529] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-438fa731-ac4f-4636-ae4b-8e30973002cd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.508647] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('438fa731-ac4f-4636-ae4b-8e30973002cd',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.751966] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fc6010b2-a356-4e5d-898a-bf9ca32456ec',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.752780] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fc6010b2-a356-4e5d-898a-bf9ca32456ec: rpc.has_security_group_logging(os_id): False [ 908.754144] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.773724] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.773724] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.773724] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.774060] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.774060] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.774161] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.774236] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.774973] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.774973] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.774973] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.774973] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fc6010b2-a356-4e5d-898a-bf9ca32456ec is going to be created. [ 908.828443] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.828443] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.828443] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.828443] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.828443] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.838737] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fc6010b2-a356-4e5d-898a-bf9ca32456ec in Status: IN_PROGRESS for 2s [ 909.010813] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('438fa731-ac4f-4636-ae4b-8e30973002cd',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.254602] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.254801] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.254900] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.255205] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.255322] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.255435] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc6010b2-a356-4e5d-898a-bf9ca32456ec is going to be updated. [ 909.256740] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.256874] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.256945] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.257155] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.257288] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.257355] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b is going to be updated. [ 909.289676] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.289676] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.289676] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.289676] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.289676] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.292297] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.292297] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.292564] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.292678] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.293271] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.306879] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc6010b2-a356-4e5d-898a-bf9ca32456ec in Status: IN_PROGRESS for 2s [ 909.307687] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b in Status: IN_PROGRESS for 2s [ 909.502855] env[70392]: INFO networking_nsxv3.common.synchronization [req-5cf91c52-f0a4-481b-8589-23a84546e822 req-b681381b-84ab-44ec-8738-7af557704826 tempest-ServerRescueTestJSON-347177866 tempest-ServerRescueTestJSON-347177866-project-member] Enqueued Resource ID: 03a8a1fe-a465-4403-8e2c-2170f54b59a0 with Priority: HIGHEST for action security_group_members [ 909.503538] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03a8a1fe-a465-4403-8e2c-2170f54b59a0 with Priority: HIGHEST for action security_group_members [ 909.503974] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-03a8a1fe-a465-4403-8e2c-2170f54b59a0 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.504247] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03a8a1fe-a465-4403-8e2c-2170f54b59a0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.504402] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03a8a1fe-a465-4403-8e2c-2170f54b59a0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.504684] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03a8a1fe-a465-4403-8e2c-2170f54b59a0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.504936] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.505153] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.505325] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.505565] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.505734] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.505903] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('03a8a1fe-a465-4403-8e2c-2170f54b59a0',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.513539] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 438fa731-ac4f-4636-ae4b-8e30973002cd: rpc.has_security_group_logging(os_id): False [ 909.535422] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.535603] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.535686] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.535937] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.536066] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.536297] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.536414] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.536533] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.536663] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.536747] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.536837] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 438fa731-ac4f-4636-ae4b-8e30973002cd is going to be created. [ 909.592436] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.592585] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.592652] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.592858] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.593041] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.605160] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 438fa731-ac4f-4636-ae4b-8e30973002cd in Status: IN_PROGRESS for 2s [ 909.963414] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-726 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.963842] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-726" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.963842] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-726" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.964327] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-726" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.964667] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.965699] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.965699] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.965847] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.966423] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.966423] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 909.966423] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 909.966609] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 909.966847] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 909.967180] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 909.967374] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 909.967567] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 909.992685] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 909.992685] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 909.992903] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 909.993073] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-726" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.993472] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-cdd83c33-8f84-4381-bf47-1f7bbc966cc7 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.993712] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-cdd83c33-8f84-4381-bf47-1f7bbc966cc7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.993878] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-cdd83c33-8f84-4381-bf47-1f7bbc966cc7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.994275] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-cdd83c33-8f84-4381-bf47-1f7bbc966cc7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.994469] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cdd83c33-8f84-4381-bf47-1f7bbc966cc7',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.010418] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('03a8a1fe-a465-4403-8e2c-2170f54b59a0',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.497853] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.498074] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.498158] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.498465] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.498634] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.499224] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port cdd83c33-8f84-4381-bf47-1f7bbc966cc7 not found, creating... [ 910.499224] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.499474] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.499474] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.499743] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.499922] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.500235] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.500450] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.500574] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.500795] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.500935] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.501101] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: cdd83c33-8f84-4381-bf47-1f7bbc966cc7 is going to be created. [ 910.513195] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('03a8a1fe-a465-4403-8e2c-2170f54b59a0',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.523573] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.523873] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.524151] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.524578] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.525558] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.525558] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-cdd83c33-8f84-4381-bf47-1f7bbc966cc7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.851355] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fc6010b2-a356-4e5d-898a-bf9ca32456ec in Status: SUCCESS [ 910.851594] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fc6010b2-a356-4e5d-898a-bf9ca32456ec" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.851768] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fc6010b2-a356-4e5d-898a-bf9ca32456ec" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.851982] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fc6010b2-a356-4e5d-898a-bf9ca32456ec" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.852107] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fc6010b2-a356-4e5d-898a-bf9ca32456ec',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.016579] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.017012] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.017012] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.017095] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.017584] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.017584] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03a8a1fe-a465-4403-8e2c-2170f54b59a0 is going to be updated. [ 911.046919] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.047091] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.047163] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.047371] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.048829] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.060686] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03a8a1fe-a465-4403-8e2c-2170f54b59a0 in Status: IN_PROGRESS for 2s [ 911.319997] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b in Status: SUCCESS [ 911.320245] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.320417] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.320643] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.320828] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.320948] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.321026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.321297] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.321442] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.321492] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.323820] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc6010b2-a356-4e5d-898a-bf9ca32456ec in Status: SUCCESS [ 911.324246] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc6010b2-a356-4e5d-898a-bf9ca32456ec" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.325184] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc6010b2-a356-4e5d-898a-bf9ca32456ec" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.325334] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc6010b2-a356-4e5d-898a-bf9ca32456ec" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.325672] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.326015] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.326200] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.326763] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.326924] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.327068] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc6010b2-a356-4e5d-898a-bf9ca32456ec',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.329494] env[70392]: INFO networking_nsxv3.common.synchronization [req-5cf91c52-f0a4-481b-8589-23a84546e822 req-0b2ed1f9-5493-452d-bff5-bf9f8192b2ba service nova] Enqueued Resource ID: 03a8a1fe-a465-4403-8e2c-2170f54b59a0 with Priority: HIGHEST for action security_group_rules [ 911.330976] env[70392]: INFO networking_nsxv3.common.synchronization [req-5cf91c52-f0a4-481b-8589-23a84546e822 req-0b2ed1f9-5493-452d-bff5-bf9f8192b2ba service nova] Enqueued Resource ID: 03a8a1fe-a465-4403-8e2c-2170f54b59a0 with Priority: HIGHEST for action security_group_members [ 911.331562] env[70392]: INFO networking_nsxv3.common.synchronization [req-5cf91c52-f0a4-481b-8589-23a84546e822 req-0b2ed1f9-5493-452d-bff5-bf9f8192b2ba service nova] Enqueued Resource ID: cdd83c33-8f84-4381-bf47-1f7bbc966cc7 with Priority: HIGHEST for action port [ 911.333097] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03a8a1fe-a465-4403-8e2c-2170f54b59a0 with Priority: HIGHEST for action security_group_rules [ 911.336040] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03a8a1fe-a465-4403-8e2c-2170f54b59a0 with Priority: HIGHEST for action security_group_members [ 911.336040] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdd83c33-8f84-4381-bf47-1f7bbc966cc7 with Priority: HIGHEST for action port [ 911.336040] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-03a8a1fe-a465-4403-8e2c-2170f54b59a0 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.336040] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-03a8a1fe-a465-4403-8e2c-2170f54b59a0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.336040] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-03a8a1fe-a465-4403-8e2c-2170f54b59a0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.336040] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-03a8a1fe-a465-4403-8e2c-2170f54b59a0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.336040] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('03a8a1fe-a465-4403-8e2c-2170f54b59a0',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.336511] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-03a8a1fe-a465-4403-8e2c-2170f54b59a0 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.336614] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03a8a1fe-a465-4403-8e2c-2170f54b59a0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.337645] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-cdd83c33-8f84-4381-bf47-1f7bbc966cc7 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.337815] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cdd83c33-8f84-4381-bf47-1f7bbc966cc7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.337889] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cdd83c33-8f84-4381-bf47-1f7bbc966cc7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.338091] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cdd83c33-8f84-4381-bf47-1f7bbc966cc7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.338212] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cdd83c33-8f84-4381-bf47-1f7bbc966cc7',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.354281] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc6010b2-a356-4e5d-898a-bf9ca32456ec taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.354474] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc6010b2-a356-4e5d-898a-bf9ca32456ec" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.619206] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 438fa731-ac4f-4636-ae4b-8e30973002cd in Status: SUCCESS [ 911.619532] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-438fa731-ac4f-4636-ae4b-8e30973002cd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.806848] env[70392]: INFO networking_nsxv3.common.synchronization [req-3841c700-b837-42bb-aa12-1e4be339810e req-0a7eab58-b53e-49aa-b81f-e9385905b33b tempest-ServersNegativeTestMultiTenantJSON-1712723732 tempest-ServersNegativeTestMultiTenantJSON-1712723732-project-member] Enqueued Resource ID: 1c75159c-a2db-4a16-8163-159ea78c9c84 with Priority: HIGHEST for action security_group_members [ 911.807435] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c75159c-a2db-4a16-8163-159ea78c9c84 with Priority: HIGHEST for action security_group_members [ 911.807745] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c75159c-a2db-4a16-8163-159ea78c9c84 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.807865] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c75159c-a2db-4a16-8163-159ea78c9c84" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.808089] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c75159c-a2db-4a16-8163-159ea78c9c84" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.808257] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c75159c-a2db-4a16-8163-159ea78c9c84" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.808426] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.808554] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.808644] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.808806] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.808905] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.808998] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c75159c-a2db-4a16-8163-159ea78c9c84',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.830359] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.832839] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fc6010b2-a356-4e5d-898a-bf9ca32456ec',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.840986] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-03a8a1fe-a465-4403-8e2c-2170f54b59a0 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.840986] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03a8a1fe-a465-4403-8e2c-2170f54b59a0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.841519] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cdd83c33-8f84-4381-bf47-1f7bbc966cc7 with status ACTIVE [ 911.841519] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.841707] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.841707] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.841912] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.842147] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.842202] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.842275] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.842335] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.842608] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.842608] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.842815] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.843135] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.843135] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.843135] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.843135] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.843270] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cdd83c33-8f84-4381-bf47-1f7bbc966cc7 is going to be updated. [ 911.865155] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.866722] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.866722] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.866722] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.866722] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.866722] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cdd83c33-8f84-4381-bf47-1f7bbc966cc7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.312180] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.312515] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.312515] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.312638] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.312726] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.312983] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.313096] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.313169] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.313311] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.313397] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.313483] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c75159c-a2db-4a16-8163-159ea78c9c84 is going to be updated. [ 912.332017] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.335280] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fc6010b2-a356-4e5d-898a-bf9ca32456ec',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.343028] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.343028] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.343201] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.343292] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.343448] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.355828] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c75159c-a2db-4a16-8163-159ea78c9c84 in Status: IN_PROGRESS for 2s [ 912.835433] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.835586] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.835677] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.836334] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.836334] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.836334] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b is going to be updated. [ 912.837628] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.837759] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.837926] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.838151] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.838151] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.838278] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc6010b2-a356-4e5d-898a-bf9ca32456ec is going to be updated. [ 912.871390] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.871566] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.871639] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.871845] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.871986] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.877034] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.877168] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.877237] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.877601] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.877699] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.889884] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc6010b2-a356-4e5d-898a-bf9ca32456ec in Status: IN_PROGRESS for 2s [ 912.890532] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b in Status: IN_PROGRESS for 2s [ 913.072275] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03a8a1fe-a465-4403-8e2c-2170f54b59a0 in Status: SUCCESS [ 913.072407] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03a8a1fe-a465-4403-8e2c-2170f54b59a0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.072553] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03a8a1fe-a465-4403-8e2c-2170f54b59a0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.072770] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03a8a1fe-a465-4403-8e2c-2170f54b59a0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.072964] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.073089] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.073151] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.073325] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.073399] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.073497] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('03a8a1fe-a465-4403-8e2c-2170f54b59a0',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.576348] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('03a8a1fe-a465-4403-8e2c-2170f54b59a0',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.082029] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('03a8a1fe-a465-4403-8e2c-2170f54b59a0',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.367545] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c75159c-a2db-4a16-8163-159ea78c9c84 in Status: SUCCESS [ 914.367730] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c75159c-a2db-4a16-8163-159ea78c9c84 deletion is rescheduled due to dependency. [ 914.367837] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c75159c-a2db-4a16-8163-159ea78c9c84" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.584694] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.585009] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.585009] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.585150] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.585273] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.585341] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03a8a1fe-a465-4403-8e2c-2170f54b59a0 is going to be updated. [ 914.617029] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.617029] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.617029] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.617029] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.617029] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.625427] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03a8a1fe-a465-4403-8e2c-2170f54b59a0 in Status: IN_PROGRESS for 2s [ 914.904510] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc6010b2-a356-4e5d-898a-bf9ca32456ec in Status: SUCCESS [ 914.904510] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc6010b2-a356-4e5d-898a-bf9ca32456ec" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.906674] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b in Status: SUCCESS [ 914.906834] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.907053] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc6010b2-a356-4e5d-898a-bf9ca32456ec" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.907383] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc6010b2-a356-4e5d-898a-bf9ca32456ec" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.907600] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.911250] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.911414] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.911586] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.911676] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.911809] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc6010b2-a356-4e5d-898a-bf9ca32456ec" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.911864] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fc6010b2-a356-4e5d-898a-bf9ca32456ec',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.913534] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.913973] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.914204] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.914405] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.914511] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.914700] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.914806] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.914917] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.915123] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.916037] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.916037] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.916037] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.916037] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.916037] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.916037] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.916037] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.917587] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.917587] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.917587] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.419465] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fc6010b2-a356-4e5d-898a-bf9ca32456ec',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.420570] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b: rpc.has_security_group_logging(os_id): False [ 915.438828] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.438965] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.439087] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.439260] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.439344] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.439539] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.439637] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.439695] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.439837] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.439911] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.440115] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.440208] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.440267] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.440405] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.441082] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.441082] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.441082] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.441082] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.441082] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.441082] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.441082] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b is going to be updated. [ 915.509651] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.509651] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.509651] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.509917] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.509917] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.525352] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b in Status: IN_PROGRESS for 2s [ 915.922452] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fc6010b2-a356-4e5d-898a-bf9ca32456ec: rpc.has_security_group_logging(os_id): False [ 915.940784] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.941050] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.941112] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.941713] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.941713] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.942067] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.942240] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.942240] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.942489] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.942627] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.943954] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fc6010b2-a356-4e5d-898a-bf9ca32456ec is going to be updated. [ 915.999412] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.999412] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.999412] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.999412] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.999412] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.013557] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fc6010b2-a356-4e5d-898a-bf9ca32456ec in Status: IN_PROGRESS for 2s [ 916.641156] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03a8a1fe-a465-4403-8e2c-2170f54b59a0 in Status: SUCCESS [ 916.641514] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03a8a1fe-a465-4403-8e2c-2170f54b59a0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.642116] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03a8a1fe-a465-4403-8e2c-2170f54b59a0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.642116] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03a8a1fe-a465-4403-8e2c-2170f54b59a0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.642116] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.642578] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.642578] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.642578] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.642578] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.643118] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03a8a1fe-a465-4403-8e2c-2170f54b59a0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.643118] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('03a8a1fe-a465-4403-8e2c-2170f54b59a0',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.745348] env[70392]: INFO networking_nsxv3.common.synchronization [req-2e5ef29b-9ab1-4168-9060-b36d6637fc31 req-14be90fc-688b-47c1-ab3f-dc30df8b2af1 tempest-DeleteServersTestJSON-1676313022 tempest-DeleteServersTestJSON-1676313022-project-member] Enqueued Resource ID: ce79170a-31ce-429e-8e08-a911557872f4 with Priority: HIGHEST for action security_group_members [ 916.745870] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce79170a-31ce-429e-8e08-a911557872f4 with Priority: HIGHEST for action security_group_members [ 916.746171] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce79170a-31ce-429e-8e08-a911557872f4 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.746287] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.746367] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.746573] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.746724] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.746817] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.746872] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.747775] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.747904] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.749105] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce79170a-31ce-429e-8e08-a911557872f4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.146768] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-03a8a1fe-a465-4403-8e2c-2170f54b59a0 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.147268] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03a8a1fe-a465-4403-8e2c-2170f54b59a0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.147633] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03a8a1fe-a465-4403-8e2c-2170f54b59a0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.147921] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03a8a1fe-a465-4403-8e2c-2170f54b59a0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.148311] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.149430] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.149613] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.149879] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.149982] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.150102] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03a8a1fe-a465-4403-8e2c-2170f54b59a0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.150303] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-03a8a1fe-a465-4403-8e2c-2170f54b59a0 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.150522] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03a8a1fe-a465-4403-8e2c-2170f54b59a0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.150522] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03a8a1fe-a465-4403-8e2c-2170f54b59a0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.150920] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03a8a1fe-a465-4403-8e2c-2170f54b59a0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.150920] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.150920] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.151627] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.151919] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.153288] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.153288] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03a8a1fe-a465-4403-8e2c-2170f54b59a0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.153288] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('03a8a1fe-a465-4403-8e2c-2170f54b59a0',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.179601] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-422 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.180253] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-422" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.180763] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-422" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.181607] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-422" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.183642] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.183642] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.183642] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.183913] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.184021] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.185154] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 917.185154] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 917.185378] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 917.185378] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 917.185561] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 917.185642] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 917.186443] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 917.208417] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 917.208832] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 917.209026] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 917.209319] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-422" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.209748] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-14968730-932a-445c-8fb6-f855a6289e7e taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.209935] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-14968730-932a-445c-8fb6-f855a6289e7e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.210071] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-14968730-932a-445c-8fb6-f855a6289e7e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.210785] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-14968730-932a-445c-8fb6-f855a6289e7e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.210785] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14968730-932a-445c-8fb6-f855a6289e7e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.255243] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.255404] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.255479] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.255701] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.255785] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.256049] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.256125] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.256175] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.256291] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.256371] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.256460] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce79170a-31ce-429e-8e08-a911557872f4 is going to be deleted. [ 917.299618] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.300290] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.300530] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.300869] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.301291] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.301291] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.540132] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b in Status: SUCCESS [ 917.540132] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.540132] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.540132] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.540132] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.658029] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 03a8a1fe-a465-4403-8e2c-2170f54b59a0: rpc.has_security_group_logging(os_id): False [ 917.692136] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.692136] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.692270] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.692626] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.715723] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.716507] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.716507] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.716507] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.716683] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.716761] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 14968730-932a-445c-8fb6-f855a6289e7e not found, creating... [ 917.717058] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.717228] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.717349] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.717574] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.717733] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.718041] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.718203] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.718324] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.718546] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.718689] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.718852] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 14968730-932a-445c-8fb6-f855a6289e7e is going to be created. [ 917.724181] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.724447] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.724564] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.724633] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.724824] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.724904] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.725520] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.725578] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.725616] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.725762] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.725843] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.726038] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.726135] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.726197] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.726340] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.726417] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.726568] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 03a8a1fe-a465-4403-8e2c-2170f54b59a0 is going to be updated. [ 917.760674] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.760908] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.760994] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.761354] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.761699] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.761989] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-14968730-932a-445c-8fb6-f855a6289e7e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.828524] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.828660] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.828660] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.828873] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.829667] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.852080] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 03a8a1fe-a465-4403-8e2c-2170f54b59a0 in Status: IN_PROGRESS for 2s [ 918.030459] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fc6010b2-a356-4e5d-898a-bf9ca32456ec in Status: SUCCESS [ 918.030806] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fc6010b2-a356-4e5d-898a-bf9ca32456ec" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.042785] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.043112] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.043370] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.043468] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.043725] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.043909] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.044043] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.044272] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.044441] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.044598] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.044745] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.548126] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.548526] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.548526] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.549083] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.549370] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.549548] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.549793] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.549863] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.549997] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.550077] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.550211] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.550310] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.550366] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.550508] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.550667] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.550886] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.550886] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.551046] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.551122] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.551205] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.551276] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.564820] env[70392]: INFO networking_nsxv3.common.synchronization [req-2e5ef29b-9ab1-4168-9060-b36d6637fc31 req-a546012d-f846-4af6-8a0d-ba5b97d94006 service nova] Enqueued Resource ID: ce79170a-31ce-429e-8e08-a911557872f4 with Priority: HIGHEST for action security_group_rules [ 918.565028] env[70392]: INFO networking_nsxv3.common.synchronization [req-2e5ef29b-9ab1-4168-9060-b36d6637fc31 req-a546012d-f846-4af6-8a0d-ba5b97d94006 service nova] Enqueued Resource ID: ce79170a-31ce-429e-8e08-a911557872f4 with Priority: HIGHEST for action security_group_members [ 918.565180] env[70392]: INFO networking_nsxv3.common.synchronization [req-2e5ef29b-9ab1-4168-9060-b36d6637fc31 req-a546012d-f846-4af6-8a0d-ba5b97d94006 service nova] Enqueued Resource ID: 14968730-932a-445c-8fb6-f855a6289e7e with Priority: HIGHEST for action port [ 918.565842] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce79170a-31ce-429e-8e08-a911557872f4 with Priority: HIGHEST for action security_group_rules [ 918.565981] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce79170a-31ce-429e-8e08-a911557872f4 with Priority: HIGHEST for action security_group_members [ 918.566718] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14968730-932a-445c-8fb6-f855a6289e7e with Priority: HIGHEST for action port [ 918.566955] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ce79170a-31ce-429e-8e08-a911557872f4 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.567107] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.567174] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.567381] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.567467] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ce79170a-31ce-429e-8e08-a911557872f4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.568323] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce79170a-31ce-429e-8e08-a911557872f4 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.568456] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.568520] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.568674] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.568823] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.568942] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.568986] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.569189] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.569189] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.569374] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce79170a-31ce-429e-8e08-a911557872f4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.570261] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-14968730-932a-445c-8fb6-f855a6289e7e taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.570455] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-14968730-932a-445c-8fb6-f855a6289e7e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.570455] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-14968730-932a-445c-8fb6-f855a6289e7e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.570966] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-14968730-932a-445c-8fb6-f855a6289e7e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.571071] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14968730-932a-445c-8fb6-f855a6289e7e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.925905] env[70392]: INFO networking_nsxv3.common.synchronization [req-30624ef5-482f-4cbf-9767-4d7d59b854e9 req-e964d539-0262-42a0-9efb-a8321ff7a320 tempest-VolumesAssistedSnapshotsTest-1612074774 tempest-VolumesAssistedSnapshotsTest-1612074774-project-member] Enqueued Resource ID: 247680ec-824d-41ac-8735-1edb7b119a99 with Priority: HIGHEST for action security_group_members [ 918.928208] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 247680ec-824d-41ac-8735-1edb7b119a99 with Priority: HIGHEST for action security_group_members [ 918.928208] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-247680ec-824d-41ac-8735-1edb7b119a99 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.928208] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-247680ec-824d-41ac-8735-1edb7b119a99" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.928208] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-247680ec-824d-41ac-8735-1edb7b119a99" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.928208] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-247680ec-824d-41ac-8735-1edb7b119a99" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.928208] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.928208] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.928208] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.928924] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.930195] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.930195] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('247680ec-824d-41ac-8735-1edb7b119a99',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.055404] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b: rpc.has_security_group_logging(os_id): False [ 919.075416] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.075416] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.075416] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.075416] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.075416] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.075416] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.075416] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.075416] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.075416] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.075416] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.075416] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.076549] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.076794] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.077133] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.077342] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.078019] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.080028] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.080028] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.080028] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.080028] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.080028] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b is going to be updated. [ 919.081184] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ce79170a-31ce-429e-8e08-a911557872f4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.082433] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce79170a-31ce-429e-8e08-a911557872f4 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.082748] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.083080] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 14968730-932a-445c-8fb6-f855a6289e7e with status ACTIVE [ 919.083378] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.083660] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.083873] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.084190] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.084422] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.085040] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.086028] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.086028] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.086028] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.086028] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.086028] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.086503] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.086684] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.086958] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.089028] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.089028] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 14968730-932a-445c-8fb6-f855a6289e7e is going to be updated. [ 919.114318] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.114318] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.114318] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.114318] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.114318] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.114318] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-14968730-932a-445c-8fb6-f855a6289e7e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.158286] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.158543] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.158543] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.158749] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.158898] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.186199] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b in Status: IN_PROGRESS for 2s [ 919.431292] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.431518] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.431602] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.434367] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.434367] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.434367] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.434367] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.434367] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.434367] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.434367] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.434367] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 247680ec-824d-41ac-8735-1edb7b119a99 is going to be updated. [ 919.461589] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.461793] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.461793] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.462029] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.462175] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.474903] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 247680ec-824d-41ac-8735-1edb7b119a99 in Status: IN_PROGRESS for 2s [ 919.590394] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ce79170a-31ce-429e-8e08-a911557872f4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.878270] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 03a8a1fe-a465-4403-8e2c-2170f54b59a0 in Status: SUCCESS [ 919.878510] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-03a8a1fe-a465-4403-8e2c-2170f54b59a0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.095020] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.095020] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.095020] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.095020] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.095020] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.095020] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce79170a-31ce-429e-8e08-a911557872f4 is going to be created. [ 920.119528] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.119755] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.119755] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.119974] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.120433] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.135234] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce79170a-31ce-429e-8e08-a911557872f4 in Status: UNINITIALIZED for 2s [ 921.206898] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b in Status: SUCCESS [ 921.207226] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.488346] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 247680ec-824d-41ac-8735-1edb7b119a99 in Status: SUCCESS [ 921.488592] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 247680ec-824d-41ac-8735-1edb7b119a99 deletion is rescheduled due to dependency. [ 921.488740] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-247680ec-824d-41ac-8735-1edb7b119a99" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.146553] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce79170a-31ce-429e-8e08-a911557872f4 in Status: UNINITIALIZED for 4s [ 922.485677] env[70392]: INFO networking_nsxv3.common.synchronization [req-1d247caf-81f0-4f1d-8662-6649dc169a56 req-b67d6b1a-c7c2-4533-b6ae-5e8f5304b94c tempest-ServerActionsTestOtherB-779604050 tempest-ServerActionsTestOtherB-779604050-project-member] Enqueued Resource ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 with Priority: HIGHEST for action security_group_members [ 922.486303] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 with Priority: HIGHEST for action security_group_members [ 922.486661] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.486737] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.486861] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.488184] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.488184] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.488184] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.488184] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.488184] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.488184] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.488184] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.961029] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-452 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.961267] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-452" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.961450] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-452" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.961750] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-452" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.962055] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.963204] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.963204] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.963204] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.963204] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.963204] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 922.963204] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 922.963204] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 922.963563] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 922.963640] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 922.963751] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 922.963908] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 922.985709] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 922.985899] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 922.986058] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 922.986253] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-452" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.986581] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-83b816dc-98ae-40f4-9f77-0b04374bcb38 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.986767] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-83b816dc-98ae-40f4-9f77-0b04374bcb38" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.986878] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-83b816dc-98ae-40f4-9f77-0b04374bcb38" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.987252] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-83b816dc-98ae-40f4-9f77-0b04374bcb38" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.987400] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83b816dc-98ae-40f4-9f77-0b04374bcb38',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.990971] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.991142] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.991210] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.991416] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.991581] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.991816] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.992247] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.992247] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.992247] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.992440] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.992440] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 already deleted. [ 922.992533] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.493030] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.493030] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.493030] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.493030] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.493030] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.493030] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 83b816dc-98ae-40f4-9f77-0b04374bcb38 not found, creating... [ 923.493030] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.493030] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.493030] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.493030] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.493030] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.493766] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.493766] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.493766] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.493766] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.493921] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.494083] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 83b816dc-98ae-40f4-9f77-0b04374bcb38 is going to be created. [ 923.518923] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.519196] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.519281] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.519577] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.519820] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.520121] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-83b816dc-98ae-40f4-9f77-0b04374bcb38" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.157380] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce79170a-31ce-429e-8e08-a911557872f4 in Status: SUCCESS [ 924.157665] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.158242] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.158242] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.158402] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.158402] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.158505] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.158631] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.158732] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.158834] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.158940] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ce79170a-31ce-429e-8e08-a911557872f4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.455438] env[70392]: INFO networking_nsxv3.common.synchronization [req-1d247caf-81f0-4f1d-8662-6649dc169a56 req-bbf576a1-49f4-4036-9294-2a46a2a389a1 service nova] Enqueued Resource ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 with Priority: HIGHEST for action security_group_rules [ 924.455746] env[70392]: INFO networking_nsxv3.common.synchronization [req-1d247caf-81f0-4f1d-8662-6649dc169a56 req-bbf576a1-49f4-4036-9294-2a46a2a389a1 service nova] Enqueued Resource ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 with Priority: HIGHEST for action security_group_members [ 924.455924] env[70392]: INFO networking_nsxv3.common.synchronization [req-1d247caf-81f0-4f1d-8662-6649dc169a56 req-bbf576a1-49f4-4036-9294-2a46a2a389a1 service nova] Enqueued Resource ID: 83b816dc-98ae-40f4-9f77-0b04374bcb38 with Priority: HIGHEST for action port [ 924.456191] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 with Priority: HIGHEST for action security_group_rules [ 924.456318] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 with Priority: HIGHEST for action security_group_members [ 924.456414] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83b816dc-98ae-40f4-9f77-0b04374bcb38 with Priority: HIGHEST for action port [ 924.457024] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.460666] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.460849] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.461178] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.461377] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.462470] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.463056] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.463203] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.463454] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.463687] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.463942] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.463997] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.464277] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.464445] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.464607] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.465866] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-83b816dc-98ae-40f4-9f77-0b04374bcb38 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.466057] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-83b816dc-98ae-40f4-9f77-0b04374bcb38" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.466196] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-83b816dc-98ae-40f4-9f77-0b04374bcb38" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.466423] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-83b816dc-98ae-40f4-9f77-0b04374bcb38" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.466569] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83b816dc-98ae-40f4-9f77-0b04374bcb38',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.665346] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce79170a-31ce-429e-8e08-a911557872f4 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.665726] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.665726] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.665953] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.667069] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.667277] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.667277] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.667404] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.667562] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.667658] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.668161] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce79170a-31ce-429e-8e08-a911557872f4 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.668313] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.668361] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.668508] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.668663] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.668831] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.668831] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.668961] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.669104] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.669213] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.669323] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ce79170a-31ce-429e-8e08-a911557872f4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.969905] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.970973] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.971098] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.971280] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 83b816dc-98ae-40f4-9f77-0b04374bcb38 with status ACTIVE [ 924.971449] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.971578] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.971628] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.971830] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.971917] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.972107] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.972196] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.972246] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.972403] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.972480] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.972668] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.972759] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.972818] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.972958] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.973431] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.973549] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 83b816dc-98ae-40f4-9f77-0b04374bcb38 is going to be updated. [ 925.004825] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.005041] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.005120] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.005337] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.005477] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.005645] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-83b816dc-98ae-40f4-9f77-0b04374bcb38" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.173568] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ce79170a-31ce-429e-8e08-a911557872f4: rpc.has_security_group_logging(os_id): False [ 925.199369] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.199644] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.199710] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.199931] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.200038] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.200294] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.200411] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.200475] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.200677] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.200771] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.200957] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.201061] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.201123] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.201308] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.201399] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.201643] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.201750] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.201824] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.201979] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.202067] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.202154] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ce79170a-31ce-429e-8e08-a911557872f4 is going to be created. [ 925.273215] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.273450] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.273450] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.273663] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.273874] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.290154] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ce79170a-31ce-429e-8e08-a911557872f4 in Status: IN_PROGRESS for 2s [ 925.475990] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.981087] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.981087] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.981087] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.981087] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.981087] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.981087] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 is going to be created. [ 926.006880] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.007088] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.007153] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.007333] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.007487] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.019949] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 in Status: UNINITIALIZED for 2s [ 927.309459] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ce79170a-31ce-429e-8e08-a911557872f4 in Status: SUCCESS [ 927.309825] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.765185] env[70392]: INFO networking_nsxv3.common.synchronization [req-4ed4ec22-b56e-45a6-9519-c0ea49399484 req-7f93e07c-e0e8-4318-abd3-47a9d1c1aefb tempest-ServerTagsTestJSON-478540309 tempest-ServerTagsTestJSON-478540309-project-member] Enqueued Resource ID: 7fe12613-4be5-4b59-9116-6e8887356711 with Priority: HIGHEST for action security_group_members [ 927.765731] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fe12613-4be5-4b59-9116-6e8887356711 with Priority: HIGHEST for action security_group_members [ 927.766047] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fe12613-4be5-4b59-9116-6e8887356711 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.766169] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fe12613-4be5-4b59-9116-6e8887356711" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.766236] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fe12613-4be5-4b59-9116-6e8887356711" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.766485] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fe12613-4be5-4b59-9116-6e8887356711" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.766646] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.766755] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.766825] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.766975] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.771179] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.771179] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fe12613-4be5-4b59-9116-6e8887356711',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.032120] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 in Status: SUCCESS [ 928.032531] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.032531] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.032675] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.032971] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.033094] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.033094] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.033219] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.033301] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.033381] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.033807] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.275061] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.275225] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.275432] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.275675] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.275795] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.276032] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.276155] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.276220] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.276391] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.276697] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.276697] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fe12613-4be5-4b59-9116-6e8887356711 already deleted. [ 928.276697] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fe12613-4be5-4b59-9116-6e8887356711" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.479701] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-85 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.479701] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-85" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.479701] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-85" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.479701] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-85" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.479701] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.479701] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.479701] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.479701] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.481393] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.481393] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 928.481393] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 928.481393] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 928.481393] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 928.481393] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 928.481681] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 928.481681] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 928.511554] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 928.511970] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 928.512312] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 928.513495] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-85" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.513495] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-ee1c5e5e-f52c-4a67-b519-198972f520f4 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.513495] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-ee1c5e5e-f52c-4a67-b519-198972f520f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.513495] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-ee1c5e5e-f52c-4a67-b519-198972f520f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.513495] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-ee1c5e5e-f52c-4a67-b519-198972f520f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.513697] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee1c5e5e-f52c-4a67-b519-198972f520f4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.539049] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.016166] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.016457] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.016619] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.016930] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.017098] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.017258] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port ee1c5e5e-f52c-4a67-b519-198972f520f4 not found, creating... [ 929.017528] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.017677] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.017794] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.018135] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.018294] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.018581] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.018732] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.018849] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.020796] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.020796] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.020796] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: ee1c5e5e-f52c-4a67-b519-198972f520f4 is going to be created. [ 929.040471] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.040471] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.040471] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.040614] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.040811] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.041077] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-ee1c5e5e-f52c-4a67-b519-198972f520f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.041921] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5: rpc.has_security_group_logging(os_id): False [ 929.064036] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.064259] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.064320] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.064564] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.065161] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.065384] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.065512] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.065595] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.065793] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.065916] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.065999] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 is going to be created. [ 929.132136] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.132136] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.132136] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.132136] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.132136] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.143739] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 in Status: IN_PROGRESS for 2s [ 929.579241] env[70392]: INFO networking_nsxv3.common.synchronization [None req-4baaf68a-3408-4acc-91b7-8f285e5671a5 None None] Enqueued Resource ID: fbfb3564-17e1-4025-8086-d04e956da26b with Priority: HIGHEST for action port [ 929.579795] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbfb3564-17e1-4025-8086-d04e956da26b with Priority: HIGHEST for action port [ 929.584017] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-fbfb3564-17e1-4025-8086-d04e956da26b taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.584017] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fbfb3564-17e1-4025-8086-d04e956da26b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.584017] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fbfb3564-17e1-4025-8086-d04e956da26b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.584017] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fbfb3564-17e1-4025-8086-d04e956da26b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.584017] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fbfb3564-17e1-4025-8086-d04e956da26b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.086086] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fbfb3564-17e1-4025-8086-d04e956da26b [ 930.086335] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.086470] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.086535] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.086769] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.086859] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.086954] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fbfb3564-17e1-4025-8086-d04e956da26b already deleted. [ 930.087062] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fbfb3564-17e1-4025-8086-d04e956da26b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.247369] env[70392]: INFO networking_nsxv3.common.synchronization [req-4ed4ec22-b56e-45a6-9519-c0ea49399484 req-02f2e573-7eae-4da8-91e6-497bb635f030 service nova] Enqueued Resource ID: 7fe12613-4be5-4b59-9116-6e8887356711 with Priority: HIGHEST for action security_group_rules [ 930.247558] env[70392]: INFO networking_nsxv3.common.synchronization [req-4ed4ec22-b56e-45a6-9519-c0ea49399484 req-02f2e573-7eae-4da8-91e6-497bb635f030 service nova] Enqueued Resource ID: 7fe12613-4be5-4b59-9116-6e8887356711 with Priority: HIGHEST for action security_group_members [ 930.247703] env[70392]: INFO networking_nsxv3.common.synchronization [req-4ed4ec22-b56e-45a6-9519-c0ea49399484 req-02f2e573-7eae-4da8-91e6-497bb635f030 service nova] Enqueued Resource ID: ee1c5e5e-f52c-4a67-b519-198972f520f4 with Priority: HIGHEST for action port [ 930.248602] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fe12613-4be5-4b59-9116-6e8887356711 with Priority: HIGHEST for action security_group_rules [ 930.248602] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fe12613-4be5-4b59-9116-6e8887356711 with Priority: HIGHEST for action security_group_members [ 930.248602] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee1c5e5e-f52c-4a67-b519-198972f520f4 with Priority: HIGHEST for action port [ 930.252246] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fe12613-4be5-4b59-9116-6e8887356711 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.252537] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fe12613-4be5-4b59-9116-6e8887356711" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.252537] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fe12613-4be5-4b59-9116-6e8887356711" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.252914] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fe12613-4be5-4b59-9116-6e8887356711" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.253029] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fe12613-4be5-4b59-9116-6e8887356711',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.254210] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fe12613-4be5-4b59-9116-6e8887356711 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.254302] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fe12613-4be5-4b59-9116-6e8887356711" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.254302] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fe12613-4be5-4b59-9116-6e8887356711" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.254506] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fe12613-4be5-4b59-9116-6e8887356711" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.254683] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.254876] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.254876] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.255044] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.255138] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.255249] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fe12613-4be5-4b59-9116-6e8887356711',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.256239] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-ee1c5e5e-f52c-4a67-b519-198972f520f4 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.256360] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ee1c5e5e-f52c-4a67-b519-198972f520f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.256425] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ee1c5e5e-f52c-4a67-b519-198972f520f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.256591] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ee1c5e5e-f52c-4a67-b519-198972f520f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.256671] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee1c5e5e-f52c-4a67-b519-198972f520f4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.759159] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fe12613-4be5-4b59-9116-6e8887356711 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.759451] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fe12613-4be5-4b59-9116-6e8887356711" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.760219] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7fe12613-4be5-4b59-9116-6e8887356711',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.762415] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ee1c5e5e-f52c-4a67-b519-198972f520f4 with status ACTIVE [ 930.762415] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.762832] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.762832] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.762921] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.763044] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.763380] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.763474] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.763574] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.763808] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.763934] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.764239] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.764390] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.765052] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.765052] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.765052] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.765052] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ee1c5e5e-f52c-4a67-b519-198972f520f4 is going to be updated. [ 930.792841] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.792982] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.793823] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.793823] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.793823] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.793823] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ee1c5e5e-f52c-4a67-b519-198972f520f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.157584] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 in Status: SUCCESS [ 931.158322] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.272243] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7fe12613-4be5-4b59-9116-6e8887356711',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.774465] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.774465] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.774465] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.774465] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.774465] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.774829] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fe12613-4be5-4b59-9116-6e8887356711 is going to be created. [ 931.801388] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.801571] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.801625] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.801905] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.802128] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.805101] env[70392]: INFO networking_nsxv3.common.synchronization [None req-51bccafb-7e31-4453-ab75-99a0fea7429d None None] Enqueued Resource ID: 60fdaae0-55cf-4580-a101-3f248aa81176 with Priority: HIGHEST for action port [ 931.805571] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60fdaae0-55cf-4580-a101-3f248aa81176 with Priority: HIGHEST for action port [ 931.805865] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-60fdaae0-55cf-4580-a101-3f248aa81176 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.805970] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-60fdaae0-55cf-4580-a101-3f248aa81176" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.806112] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-60fdaae0-55cf-4580-a101-3f248aa81176" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.806318] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-60fdaae0-55cf-4580-a101-3f248aa81176" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.806405] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60fdaae0-55cf-4580-a101-3f248aa81176',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.814802] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fe12613-4be5-4b59-9116-6e8887356711 in Status: UNINITIALIZED for 2s [ 932.135858] env[70392]: INFO networking_nsxv3.common.synchronization [req-8e22f9db-1577-452b-b6cf-e361af599f43 req-0a2d7e19-14c8-454e-b65a-91e1eab157d6 tempest-AttachVolumeTestJSON-1272662447 tempest-AttachVolumeTestJSON-1272662447-project-member] Enqueued Resource ID: ac589e4e-a2e5-4716-8490-eecefc1b6a5e with Priority: HIGHEST for action security_group_members [ 932.136737] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac589e4e-a2e5-4716-8490-eecefc1b6a5e with Priority: HIGHEST for action security_group_members [ 932.137246] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac589e4e-a2e5-4716-8490-eecefc1b6a5e taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.137411] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac589e4e-a2e5-4716-8490-eecefc1b6a5e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.137617] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac589e4e-a2e5-4716-8490-eecefc1b6a5e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.137813] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac589e4e-a2e5-4716-8490-eecefc1b6a5e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.138079] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.138277] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.138337] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.138574] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.138702] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.138841] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac589e4e-a2e5-4716-8490-eecefc1b6a5e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.308349] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 60fdaae0-55cf-4580-a101-3f248aa81176 [ 932.308625] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.308765] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.308839] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.309103] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.309209] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.309320] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:60fdaae0-55cf-4580-a101-3f248aa81176 already deleted. [ 932.309420] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-60fdaae0-55cf-4580-a101-3f248aa81176" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.642017] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.642227] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.642298] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.642505] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.668977] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.669636] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.669636] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.669636] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.669908] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.670758] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.670758] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac589e4e-a2e5-4716-8490-eecefc1b6a5e is going to be updated. [ 932.705595] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.705828] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.705919] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.706275] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.706452] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.736341] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac589e4e-a2e5-4716-8490-eecefc1b6a5e in Status: IN_PROGRESS for 2s [ 933.831091] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fe12613-4be5-4b59-9116-6e8887356711 in Status: SUCCESS [ 933.832130] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fe12613-4be5-4b59-9116-6e8887356711" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.832174] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fe12613-4be5-4b59-9116-6e8887356711" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.832376] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fe12613-4be5-4b59-9116-6e8887356711" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.832691] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.832691] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.832803] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.833195] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.833195] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.833195] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fe12613-4be5-4b59-9116-6e8887356711" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.833195] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7fe12613-4be5-4b59-9116-6e8887356711',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.337510] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fe12613-4be5-4b59-9116-6e8887356711 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.338029] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fe12613-4be5-4b59-9116-6e8887356711" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.339190] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fe12613-4be5-4b59-9116-6e8887356711" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.339475] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fe12613-4be5-4b59-9116-6e8887356711" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.339701] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.339819] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.339889] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.340058] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.340149] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.340601] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fe12613-4be5-4b59-9116-6e8887356711" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.340601] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fe12613-4be5-4b59-9116-6e8887356711 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.340601] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fe12613-4be5-4b59-9116-6e8887356711" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.340601] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fe12613-4be5-4b59-9116-6e8887356711" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.340786] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fe12613-4be5-4b59-9116-6e8887356711" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.340841] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.340934] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.340995] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.341146] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.342951] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.343110] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fe12613-4be5-4b59-9116-6e8887356711" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.343220] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7fe12613-4be5-4b59-9116-6e8887356711',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.523210] env[70392]: INFO networking_nsxv3.common.synchronization [req-92ce97da-a394-43bc-a629-76f880f14de9 req-4490066d-9b1c-4600-b2e8-d9b869fda3d1 tempest-ServersTestBootFromVolume-2123411636 tempest-ServersTestBootFromVolume-2123411636-project-member] Enqueued Resource ID: db50a8fd-2283-44bb-910d-f7a2f2541f14 with Priority: HIGHEST for action security_group_members [ 934.524304] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db50a8fd-2283-44bb-910d-f7a2f2541f14 with Priority: HIGHEST for action security_group_members [ 934.525336] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-db50a8fd-2283-44bb-910d-f7a2f2541f14 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.525485] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db50a8fd-2283-44bb-910d-f7a2f2541f14" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.525589] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db50a8fd-2283-44bb-910d-f7a2f2541f14" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.525879] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db50a8fd-2283-44bb-910d-f7a2f2541f14" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.526105] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.526264] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.526351] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.526547] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.526660] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.526832] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('db50a8fd-2283-44bb-910d-f7a2f2541f14',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.749577] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac589e4e-a2e5-4716-8490-eecefc1b6a5e in Status: SUCCESS [ 934.749757] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac589e4e-a2e5-4716-8490-eecefc1b6a5e deletion is rescheduled due to dependency. [ 934.749872] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac589e4e-a2e5-4716-8490-eecefc1b6a5e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.847487] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7fe12613-4be5-4b59-9116-6e8887356711: rpc.has_security_group_logging(os_id): False [ 934.866857] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.867063] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.867159] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.867731] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.867731] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.867731] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.868206] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.868206] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.868206] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.868364] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.870173] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.870173] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.870173] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.870173] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.870173] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.870431] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.870512] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.870575] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.870927] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.871090] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.871242] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fe12613-4be5-4b59-9116-6e8887356711 is going to be created. [ 934.938658] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.938807] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.938880] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.939163] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.939351] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.951928] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fe12613-4be5-4b59-9116-6e8887356711 in Status: IN_PROGRESS for 2s [ 935.030110] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.030268] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.030413] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.034021] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.034021] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.034021] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.034021] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.034021] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.034021] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.034021] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.034021] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db50a8fd-2283-44bb-910d-f7a2f2541f14 is going to be updated. [ 935.081470] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.081642] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.081681] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.081981] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.082149] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.095194] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db50a8fd-2283-44bb-910d-f7a2f2541f14 in Status: IN_PROGRESS for 2s [ 935.726181] env[70392]: INFO networking_nsxv3.common.synchronization [req-27a869c7-7e7a-43cf-aedd-c7e14b819715 req-4fafd7a3-6ede-419d-b4f1-f8ea72c835ed tempest-AttachInterfacesUnderV243Test-202360309 tempest-AttachInterfacesUnderV243Test-202360309-project-member] Enqueued Resource ID: 12c8b5a9-023e-43d6-a4a6-03004d0ac434 with Priority: HIGHEST for action security_group_members [ 935.726821] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12c8b5a9-023e-43d6-a4a6-03004d0ac434 with Priority: HIGHEST for action security_group_members [ 935.727110] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-12c8b5a9-023e-43d6-a4a6-03004d0ac434 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.727253] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12c8b5a9-023e-43d6-a4a6-03004d0ac434" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.727311] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12c8b5a9-023e-43d6-a4a6-03004d0ac434" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.727492] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12c8b5a9-023e-43d6-a4a6-03004d0ac434" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.727641] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.727736] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.727798] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.727943] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.728035] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.728128] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12c8b5a9-023e-43d6-a4a6-03004d0ac434',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.793540] env[70392]: INFO networking_nsxv3.common.synchronization [req-27a869c7-7e7a-43cf-aedd-c7e14b819715 req-4fafd7a3-6ede-419d-b4f1-f8ea72c835ed tempest-AttachInterfacesUnderV243Test-202360309 tempest-AttachInterfacesUnderV243Test-202360309-project-member] Enqueued Resource ID: 12c8b5a9-023e-43d6-a4a6-03004d0ac434 with Priority: HIGHEST for action security_group_rules [ 935.793826] env[70392]: INFO networking_nsxv3.common.synchronization [req-27a869c7-7e7a-43cf-aedd-c7e14b819715 req-4fafd7a3-6ede-419d-b4f1-f8ea72c835ed tempest-AttachInterfacesUnderV243Test-202360309 tempest-AttachInterfacesUnderV243Test-202360309-project-member] Enqueued Resource ID: 12c8b5a9-023e-43d6-a4a6-03004d0ac434 with Priority: HIGHEST for action security_group_members [ 935.793894] env[70392]: INFO networking_nsxv3.common.synchronization [req-27a869c7-7e7a-43cf-aedd-c7e14b819715 req-4fafd7a3-6ede-419d-b4f1-f8ea72c835ed tempest-AttachInterfacesUnderV243Test-202360309 tempest-AttachInterfacesUnderV243Test-202360309-project-member] Enqueued Resource ID: e6f94ef5-68db-4e62-a469-d1c64f677e29 with Priority: HIGHEST for action port [ 935.794681] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12c8b5a9-023e-43d6-a4a6-03004d0ac434 with Priority: HIGHEST for action security_group_rules [ 935.794975] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12c8b5a9-023e-43d6-a4a6-03004d0ac434 with Priority: HIGHEST for action security_group_members [ 935.794975] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6f94ef5-68db-4e62-a469-d1c64f677e29 with Priority: HIGHEST for action port [ 935.795210] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-12c8b5a9-023e-43d6-a4a6-03004d0ac434 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.795337] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-12c8b5a9-023e-43d6-a4a6-03004d0ac434" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.795402] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-12c8b5a9-023e-43d6-a4a6-03004d0ac434" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.795597] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-12c8b5a9-023e-43d6-a4a6-03004d0ac434" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.795678] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('12c8b5a9-023e-43d6-a4a6-03004d0ac434',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.796529] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-12c8b5a9-023e-43d6-a4a6-03004d0ac434 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.796627] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12c8b5a9-023e-43d6-a4a6-03004d0ac434" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.796816] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-e6f94ef5-68db-4e62-a469-d1c64f677e29 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.796931] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e6f94ef5-68db-4e62-a469-d1c64f677e29" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.796974] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e6f94ef5-68db-4e62-a469-d1c64f677e29" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.797149] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e6f94ef5-68db-4e62-a469-d1c64f677e29" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.797225] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e6f94ef5-68db-4e62-a469-d1c64f677e29',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.234091] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('12c8b5a9-023e-43d6-a4a6-03004d0ac434',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.299830] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-12c8b5a9-023e-43d6-a4a6-03004d0ac434 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.300011] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12c8b5a9-023e-43d6-a4a6-03004d0ac434" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.300282] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e6f94ef5-68db-4e62-a469-d1c64f677e29 with status ACTIVE [ 936.301174] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.301401] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.301460] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.301623] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.301720] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.301978] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.302093] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.302158] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.302328] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.302408] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.302598] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.302694] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.302777] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.302977] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.303070] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.303173] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e6f94ef5-68db-4e62-a469-d1c64f677e29 is going to be updated. [ 936.328964] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.329308] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.329366] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.329996] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.329996] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.329996] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e6f94ef5-68db-4e62-a469-d1c64f677e29" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.737705] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('12c8b5a9-023e-43d6-a4a6-03004d0ac434',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.965473] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fe12613-4be5-4b59-9116-6e8887356711 in Status: SUCCESS [ 936.965786] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fe12613-4be5-4b59-9116-6e8887356711" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.105904] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db50a8fd-2283-44bb-910d-f7a2f2541f14 in Status: SUCCESS [ 937.106483] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db50a8fd-2283-44bb-910d-f7a2f2541f14 deletion is rescheduled due to dependency. [ 937.106483] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db50a8fd-2283-44bb-910d-f7a2f2541f14" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.239898] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.239898] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.239898] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.240286] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.240286] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.240286] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12c8b5a9-023e-43d6-a4a6-03004d0ac434 is going to be updated. [ 937.272945] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.272945] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.272945] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.272945] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.272945] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.282260] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12c8b5a9-023e-43d6-a4a6-03004d0ac434 in Status: IN_PROGRESS for 2s [ 937.785106] env[70392]: INFO networking_nsxv3.common.synchronization [req-11c5d6c9-be48-48aa-9c1f-3890bf0b2bf5 req-1effddba-9f1c-4c63-80e1-81ae757581b3 tempest-ServerRescueTestJSON-347177866 tempest-ServerRescueTestJSON-347177866-project-member] Enqueued Resource ID: 03a8a1fe-a465-4403-8e2c-2170f54b59a0 with Priority: HIGHEST for action security_group_members [ 937.785594] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03a8a1fe-a465-4403-8e2c-2170f54b59a0 with Priority: HIGHEST for action security_group_members [ 937.785896] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-03a8a1fe-a465-4403-8e2c-2170f54b59a0 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.786504] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03a8a1fe-a465-4403-8e2c-2170f54b59a0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.786686] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03a8a1fe-a465-4403-8e2c-2170f54b59a0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.786938] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03a8a1fe-a465-4403-8e2c-2170f54b59a0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.787282] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.788245] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.788245] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.788245] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.788245] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.788245] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('03a8a1fe-a465-4403-8e2c-2170f54b59a0',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.290788] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('03a8a1fe-a465-4403-8e2c-2170f54b59a0',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.793648] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('03a8a1fe-a465-4403-8e2c-2170f54b59a0',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.818753] env[70392]: INFO networking_nsxv3.common.synchronization [req-39b81d9d-9db9-41f2-9cbb-931ae00e9209 req-48f6e250-6363-40a9-b33c-9e6cf1d8f901 tempest-AttachInterfacesUnderV243Test-202360309 tempest-AttachInterfacesUnderV243Test-202360309-project-member] Enqueued Resource ID: 12c8b5a9-023e-43d6-a4a6-03004d0ac434 with Priority: HIGHEST for action security_group_members [ 938.819347] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12c8b5a9-023e-43d6-a4a6-03004d0ac434 with Priority: HIGHEST for action security_group_members [ 938.819655] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-12c8b5a9-023e-43d6-a4a6-03004d0ac434 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.819766] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12c8b5a9-023e-43d6-a4a6-03004d0ac434" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.848254] env[70392]: INFO networking_nsxv3.common.synchronization [req-39b81d9d-9db9-41f2-9cbb-931ae00e9209 req-48f6e250-6363-40a9-b33c-9e6cf1d8f901 tempest-AttachInterfacesUnderV243Test-202360309 tempest-AttachInterfacesUnderV243Test-202360309-project-member] Enqueued Resource ID: 12c8b5a9-023e-43d6-a4a6-03004d0ac434 with Priority: HIGHEST for action security_group_rules [ 938.848439] env[70392]: INFO networking_nsxv3.common.synchronization [req-39b81d9d-9db9-41f2-9cbb-931ae00e9209 req-48f6e250-6363-40a9-b33c-9e6cf1d8f901 tempest-AttachInterfacesUnderV243Test-202360309 tempest-AttachInterfacesUnderV243Test-202360309-project-member] Enqueued Resource ID: 12c8b5a9-023e-43d6-a4a6-03004d0ac434 with Priority: HIGHEST for action security_group_members [ 938.848588] env[70392]: INFO networking_nsxv3.common.synchronization [req-39b81d9d-9db9-41f2-9cbb-931ae00e9209 req-48f6e250-6363-40a9-b33c-9e6cf1d8f901 tempest-AttachInterfacesUnderV243Test-202360309 tempest-AttachInterfacesUnderV243Test-202360309-project-member] Enqueued Resource ID: e6f94ef5-68db-4e62-a469-d1c64f677e29 with Priority: HIGHEST for action port [ 938.849259] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12c8b5a9-023e-43d6-a4a6-03004d0ac434 with Priority: HIGHEST for action security_group_rules [ 938.849398] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12c8b5a9-023e-43d6-a4a6-03004d0ac434 with Priority: HIGHEST for action security_group_members [ 938.849496] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6f94ef5-68db-4e62-a469-d1c64f677e29 with Priority: HIGHEST for action port [ 938.850616] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-12c8b5a9-023e-43d6-a4a6-03004d0ac434 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.850616] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-12c8b5a9-023e-43d6-a4a6-03004d0ac434" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.850616] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-12c8b5a9-023e-43d6-a4a6-03004d0ac434 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.850790] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12c8b5a9-023e-43d6-a4a6-03004d0ac434" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.851069] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-e6f94ef5-68db-4e62-a469-d1c64f677e29 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.851327] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e6f94ef5-68db-4e62-a469-d1c64f677e29" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.851423] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e6f94ef5-68db-4e62-a469-d1c64f677e29" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.851657] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e6f94ef5-68db-4e62-a469-d1c64f677e29" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.851861] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e6f94ef5-68db-4e62-a469-d1c64f677e29',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.296119] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12c8b5a9-023e-43d6-a4a6-03004d0ac434 in Status: SUCCESS [ 939.296474] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12c8b5a9-023e-43d6-a4a6-03004d0ac434" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.296679] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.296811] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.296871] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.297088] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.297173] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.297267] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03a8a1fe-a465-4403-8e2c-2170f54b59a0 is going to be updated. [ 939.298328] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12c8b5a9-023e-43d6-a4a6-03004d0ac434" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.299034] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12c8b5a9-023e-43d6-a4a6-03004d0ac434" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.299034] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.299034] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.299034] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.299034] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.299228] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.299228] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12c8b5a9-023e-43d6-a4a6-03004d0ac434',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.329215] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.329356] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.329427] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.329630] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.329776] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.340646] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03a8a1fe-a465-4403-8e2c-2170f54b59a0 in Status: IN_PROGRESS for 2s [ 939.353582] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e6f94ef5-68db-4e62-a469-d1c64f677e29 with status ACTIVE [ 939.353867] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.354012] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.354089] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.354384] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.354470] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.355281] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.355281] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.355281] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.355281] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.355281] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.355562] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.355604] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.355683] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.355800] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.355875] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.355963] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e6f94ef5-68db-4e62-a469-d1c64f677e29 is going to be updated. [ 939.379507] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.379639] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.379780] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.379926] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.380071] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.380230] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e6f94ef5-68db-4e62-a469-d1c64f677e29" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.801895] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('12c8b5a9-023e-43d6-a4a6-03004d0ac434',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.304052] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('12c8b5a9-023e-43d6-a4a6-03004d0ac434',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.437723] env[70392]: INFO networking_nsxv3.common.synchronization [req-2b353ee2-37ef-4f0f-acf8-b85047de9bc7 req-af568983-16a4-4c77-a096-05a5043526a9 tempest-ListImageFiltersTestJSON-1434659708 tempest-ListImageFiltersTestJSON-1434659708-project-member] Enqueued Resource ID: 49e97029-e971-47d3-aa73-0fe54ba5d0b0 with Priority: HIGHEST for action security_group_members [ 940.438267] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49e97029-e971-47d3-aa73-0fe54ba5d0b0 with Priority: HIGHEST for action security_group_members [ 940.438571] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-49e97029-e971-47d3-aa73-0fe54ba5d0b0 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.438690] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49e97029-e971-47d3-aa73-0fe54ba5d0b0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.438757] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49e97029-e971-47d3-aa73-0fe54ba5d0b0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.439012] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49e97029-e971-47d3-aa73-0fe54ba5d0b0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.439446] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.439973] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.439973] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.439973] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.439973] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.440122] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49e97029-e971-47d3-aa73-0fe54ba5d0b0',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.807167] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.807463] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.807554] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.807893] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.808204] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.808336] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12c8b5a9-023e-43d6-a4a6-03004d0ac434 is going to be updated. [ 940.859768] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.859984] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.860069] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.860343] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.860546] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.872197] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12c8b5a9-023e-43d6-a4a6-03004d0ac434 in Status: IN_PROGRESS for 2s [ 940.943196] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.943362] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.943422] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.943652] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.943742] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.943943] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.944100] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.944195] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.944340] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.944419] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.944508] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49e97029-e971-47d3-aa73-0fe54ba5d0b0 already deleted. [ 940.944587] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49e97029-e971-47d3-aa73-0fe54ba5d0b0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.062594] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-325 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.062814] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-325" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.064514] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-325" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.064884] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-325" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.065148] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.065320] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.065442] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.069298] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.069298] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.069298] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 941.069298] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 941.069298] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 941.069298] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 941.069298] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 941.069298] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 941.069298] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 941.090638] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 941.091153] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 941.091986] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 941.092392] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-325" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.092826] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-b09915a5-ede2-4aac-9d4d-99c1d5d198b0 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.093270] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-b09915a5-ede2-4aac-9d4d-99c1d5d198b0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.093521] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-b09915a5-ede2-4aac-9d4d-99c1d5d198b0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.093956] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-b09915a5-ede2-4aac-9d4d-99c1d5d198b0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.094262] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b09915a5-ede2-4aac-9d4d-99c1d5d198b0',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.353430] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03a8a1fe-a465-4403-8e2c-2170f54b59a0 in Status: SUCCESS [ 941.353775] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03a8a1fe-a465-4403-8e2c-2170f54b59a0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.596772] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.597184] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.597284] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.597702] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.597776] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.597942] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port b09915a5-ede2-4aac-9d4d-99c1d5d198b0 not found, creating... [ 941.598980] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.598980] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.598980] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.598980] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.599225] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.599352] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.599522] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.599742] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.600809] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.600809] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.600809] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: b09915a5-ede2-4aac-9d4d-99c1d5d198b0 is going to be created. [ 941.653509] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.653770] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.653901] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.654206] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.654440] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.654700] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-b09915a5-ede2-4aac-9d4d-99c1d5d198b0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.362625] env[70392]: INFO networking_nsxv3.common.synchronization [req-9d567b73-5d10-4634-9e54-61e3627f3cd1 req-ec12ab97-4d9e-4a1a-ae43-f1b7fc668357 tempest-VolumesAdminNegativeTest-687729453 tempest-VolumesAdminNegativeTest-687729453-project-member] Enqueued Resource ID: 5142002e-26fc-486e-b9c2-236f95ba1fa4 with Priority: HIGHEST for action security_group_members [ 942.363498] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5142002e-26fc-486e-b9c2-236f95ba1fa4 with Priority: HIGHEST for action security_group_members [ 942.363980] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-5142002e-26fc-486e-b9c2-236f95ba1fa4 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.364197] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5142002e-26fc-486e-b9c2-236f95ba1fa4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.364317] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5142002e-26fc-486e-b9c2-236f95ba1fa4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.364720] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5142002e-26fc-486e-b9c2-236f95ba1fa4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.364989] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.365496] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.365636] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.366118] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.366263] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.366414] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5142002e-26fc-486e-b9c2-236f95ba1fa4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.667579] env[70392]: INFO networking_nsxv3.common.synchronization [req-2b353ee2-37ef-4f0f-acf8-b85047de9bc7 req-d2ed3afc-b1a3-4c76-bff4-6e238e740c28 service nova] Enqueued Resource ID: 49e97029-e971-47d3-aa73-0fe54ba5d0b0 with Priority: HIGHEST for action security_group_rules [ 942.667874] env[70392]: INFO networking_nsxv3.common.synchronization [req-2b353ee2-37ef-4f0f-acf8-b85047de9bc7 req-d2ed3afc-b1a3-4c76-bff4-6e238e740c28 service nova] Enqueued Resource ID: 49e97029-e971-47d3-aa73-0fe54ba5d0b0 with Priority: HIGHEST for action security_group_members [ 942.668136] env[70392]: INFO networking_nsxv3.common.synchronization [req-2b353ee2-37ef-4f0f-acf8-b85047de9bc7 req-d2ed3afc-b1a3-4c76-bff4-6e238e740c28 service nova] Enqueued Resource ID: b09915a5-ede2-4aac-9d4d-99c1d5d198b0 with Priority: HIGHEST for action port [ 942.668882] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49e97029-e971-47d3-aa73-0fe54ba5d0b0 with Priority: HIGHEST for action security_group_rules [ 942.669078] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49e97029-e971-47d3-aa73-0fe54ba5d0b0 with Priority: HIGHEST for action security_group_members [ 942.669223] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b09915a5-ede2-4aac-9d4d-99c1d5d198b0 with Priority: HIGHEST for action port [ 942.669540] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49e97029-e971-47d3-aa73-0fe54ba5d0b0 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.669699] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49e97029-e971-47d3-aa73-0fe54ba5d0b0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.669811] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49e97029-e971-47d3-aa73-0fe54ba5d0b0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.670107] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49e97029-e971-47d3-aa73-0fe54ba5d0b0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.670230] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49e97029-e971-47d3-aa73-0fe54ba5d0b0',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.671926] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-49e97029-e971-47d3-aa73-0fe54ba5d0b0 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.672097] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49e97029-e971-47d3-aa73-0fe54ba5d0b0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.672196] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49e97029-e971-47d3-aa73-0fe54ba5d0b0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.672418] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49e97029-e971-47d3-aa73-0fe54ba5d0b0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.672617] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.672749] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.672840] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.673053] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.673314] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.673462] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49e97029-e971-47d3-aa73-0fe54ba5d0b0',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.674454] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-b09915a5-ede2-4aac-9d4d-99c1d5d198b0 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.674665] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b09915a5-ede2-4aac-9d4d-99c1d5d198b0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.674876] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b09915a5-ede2-4aac-9d4d-99c1d5d198b0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.677893] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b09915a5-ede2-4aac-9d4d-99c1d5d198b0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.677893] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b09915a5-ede2-4aac-9d4d-99c1d5d198b0',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.870128] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.870670] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.870670] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.870960] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.870960] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.871324] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.871456] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.871528] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.871712] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.871799] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.871965] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5142002e-26fc-486e-b9c2-236f95ba1fa4 is going to be updated. [ 942.887426] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12c8b5a9-023e-43d6-a4a6-03004d0ac434 in Status: SUCCESS [ 942.887700] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12c8b5a9-023e-43d6-a4a6-03004d0ac434" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.887965] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12c8b5a9-023e-43d6-a4a6-03004d0ac434" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.888269] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12c8b5a9-023e-43d6-a4a6-03004d0ac434" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.888547] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.888722] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.888825] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.890697] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.890844] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.890995] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12c8b5a9-023e-43d6-a4a6-03004d0ac434" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.891175] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('12c8b5a9-023e-43d6-a4a6-03004d0ac434',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.892355] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12c8b5a9-023e-43d6-a4a6-03004d0ac434" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.892617] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12c8b5a9-023e-43d6-a4a6-03004d0ac434" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.892877] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.893098] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.893164] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.893404] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.893544] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.893669] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12c8b5a9-023e-43d6-a4a6-03004d0ac434',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.908342] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.908599] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.908719] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.909038] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.909279] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.924252] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5142002e-26fc-486e-b9c2-236f95ba1fa4 in Status: IN_PROGRESS for 2s [ 943.173150] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-49e97029-e971-47d3-aa73-0fe54ba5d0b0 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.173150] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49e97029-e971-47d3-aa73-0fe54ba5d0b0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.177924] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('49e97029-e971-47d3-aa73-0fe54ba5d0b0',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.178881] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b09915a5-ede2-4aac-9d4d-99c1d5d198b0 with status ACTIVE [ 943.179077] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.179196] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.179260] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.179465] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.179545] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.179717] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.179817] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.179897] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.180483] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.180483] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.180483] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.180483] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.180483] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.180674] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.180674] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.180750] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b09915a5-ede2-4aac-9d4d-99c1d5d198b0 is going to be updated. [ 943.216029] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.216029] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.216029] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.216029] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.216029] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.216029] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b09915a5-ede2-4aac-9d4d-99c1d5d198b0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.405506] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('12c8b5a9-023e-43d6-a4a6-03004d0ac434',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.405506] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('12c8b5a9-023e-43d6-a4a6-03004d0ac434',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.483131] env[70392]: INFO networking_nsxv3.common.synchronization [req-8de6df2c-bc4a-4f68-9fb9-20b9924695fe req-b113ff78-7f73-46ce-adb4-35410a8355d6 tempest-ListImageFiltersTestJSON-1434659708 tempest-ListImageFiltersTestJSON-1434659708-project-member] Enqueued Resource ID: 49e97029-e971-47d3-aa73-0fe54ba5d0b0 with Priority: HIGHEST for action security_group_members [ 943.483677] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49e97029-e971-47d3-aa73-0fe54ba5d0b0 with Priority: HIGHEST for action security_group_members [ 943.484008] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-49e97029-e971-47d3-aa73-0fe54ba5d0b0 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.484080] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49e97029-e971-47d3-aa73-0fe54ba5d0b0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.673479] env[70392]: INFO networking_nsxv3.common.synchronization [req-17d2754f-5653-406f-ac95-34e8f098f25c req-4cd4517a-8cd2-4eba-adc8-e2da8852ea58 tempest-AttachInterfacesUnderV243Test-202360309 tempest-AttachInterfacesUnderV243Test-202360309-project-member] Enqueued Resource ID: 12c8b5a9-023e-43d6-a4a6-03004d0ac434 with Priority: HIGHEST for action security_group_members [ 943.676267] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12c8b5a9-023e-43d6-a4a6-03004d0ac434 with Priority: HIGHEST for action security_group_members [ 943.677046] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-12c8b5a9-023e-43d6-a4a6-03004d0ac434 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.677177] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12c8b5a9-023e-43d6-a4a6-03004d0ac434" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.683463] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('49e97029-e971-47d3-aa73-0fe54ba5d0b0',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.909834] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 12c8b5a9-023e-43d6-a4a6-03004d0ac434: rpc.has_security_group_logging(os_id): False [ 943.909834] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('12c8b5a9-023e-43d6-a4a6-03004d0ac434',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.931026] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.931026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.931026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.931026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.931026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.931026] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.931026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.931026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.931026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.931026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.931026] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 12c8b5a9-023e-43d6-a4a6-03004d0ac434 is going to be updated. [ 943.999347] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.000152] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.000545] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.002050] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.002050] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.019136] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 12c8b5a9-023e-43d6-a4a6-03004d0ac434 in Status: IN_PROGRESS for 2s [ 944.080511] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-325 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.080867] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-325" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.081104] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-325" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.081365] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-325" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.082655] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.082856] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.084038] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.084038] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.084038] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.084038] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 944.084038] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 944.084038] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 944.084038] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 944.084389] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 944.084389] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 944.084389] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 944.120483] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 944.120483] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 944.120483] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 944.120483] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-325" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.120483] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-981ce95b-4070-4d2e-ade9-6fe1b7239ddd taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.120483] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-981ce95b-4070-4d2e-ade9-6fe1b7239ddd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.120483] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-981ce95b-4070-4d2e-ade9-6fe1b7239ddd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.120483] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-981ce95b-4070-4d2e-ade9-6fe1b7239ddd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.120483] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('981ce95b-4070-4d2e-ade9-6fe1b7239ddd',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.187835] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.188076] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.188668] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.188668] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.188668] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.188819] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49e97029-e971-47d3-aa73-0fe54ba5d0b0 is going to be created. [ 944.224139] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.224427] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.224541] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.224782] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.225065] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.239794] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49e97029-e971-47d3-aa73-0fe54ba5d0b0 in Status: UNINITIALIZED for 2s [ 944.412875] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.412875] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.412875] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.413451] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.413451] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.413505] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12c8b5a9-023e-43d6-a4a6-03004d0ac434 is going to be updated. [ 944.458245] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.458245] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.458245] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.458245] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.458434] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.469117] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12c8b5a9-023e-43d6-a4a6-03004d0ac434 in Status: IN_PROGRESS for 2s [ 944.625787] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.626060] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.626198] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.626520] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.626707] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.626877] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 981ce95b-4070-4d2e-ade9-6fe1b7239ddd not found, creating... [ 944.627177] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.627412] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.627481] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.627731] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.627853] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.628237] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.628435] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.628578] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.628821] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.628963] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.631033] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 981ce95b-4070-4d2e-ade9-6fe1b7239ddd is going to be created. [ 944.653871] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.654113] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.654336] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.654933] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.654933] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.655290] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-981ce95b-4070-4d2e-ade9-6fe1b7239ddd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.934981] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5142002e-26fc-486e-b9c2-236f95ba1fa4 in Status: SUCCESS [ 944.934981] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5142002e-26fc-486e-b9c2-236f95ba1fa4 deletion is rescheduled due to dependency. [ 944.934981] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5142002e-26fc-486e-b9c2-236f95ba1fa4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.820906] env[70392]: INFO networking_nsxv3.common.synchronization [req-8de6df2c-bc4a-4f68-9fb9-20b9924695fe req-5a1c194a-2d37-4bb0-964e-61e26bddbe8c service nova] Enqueued Resource ID: 49e97029-e971-47d3-aa73-0fe54ba5d0b0 with Priority: HIGHEST for action security_group_rules [ 945.821254] env[70392]: INFO networking_nsxv3.common.synchronization [req-8de6df2c-bc4a-4f68-9fb9-20b9924695fe req-5a1c194a-2d37-4bb0-964e-61e26bddbe8c service nova] Enqueued Resource ID: 49e97029-e971-47d3-aa73-0fe54ba5d0b0 with Priority: HIGHEST for action security_group_members [ 945.821312] env[70392]: INFO networking_nsxv3.common.synchronization [req-8de6df2c-bc4a-4f68-9fb9-20b9924695fe req-5a1c194a-2d37-4bb0-964e-61e26bddbe8c service nova] Enqueued Resource ID: 981ce95b-4070-4d2e-ade9-6fe1b7239ddd with Priority: HIGHEST for action port [ 945.821901] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49e97029-e971-47d3-aa73-0fe54ba5d0b0 with Priority: HIGHEST for action security_group_rules [ 945.822157] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49e97029-e971-47d3-aa73-0fe54ba5d0b0 with Priority: HIGHEST for action security_group_members [ 945.822321] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 981ce95b-4070-4d2e-ade9-6fe1b7239ddd with Priority: HIGHEST for action port [ 945.822624] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49e97029-e971-47d3-aa73-0fe54ba5d0b0 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.822732] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49e97029-e971-47d3-aa73-0fe54ba5d0b0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.822937] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-49e97029-e971-47d3-aa73-0fe54ba5d0b0 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.823050] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49e97029-e971-47d3-aa73-0fe54ba5d0b0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.823610] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-981ce95b-4070-4d2e-ade9-6fe1b7239ddd taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.823610] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-981ce95b-4070-4d2e-ade9-6fe1b7239ddd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.823610] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-981ce95b-4070-4d2e-ade9-6fe1b7239ddd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.823610] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-981ce95b-4070-4d2e-ade9-6fe1b7239ddd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.823957] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('981ce95b-4070-4d2e-ade9-6fe1b7239ddd',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.038474] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 12c8b5a9-023e-43d6-a4a6-03004d0ac434 in Status: SUCCESS [ 946.038761] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-12c8b5a9-023e-43d6-a4a6-03004d0ac434" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.038945] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-12c8b5a9-023e-43d6-a4a6-03004d0ac434" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.039194] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-12c8b5a9-023e-43d6-a4a6-03004d0ac434" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.039290] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('12c8b5a9-023e-43d6-a4a6-03004d0ac434',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.226493] env[70392]: INFO networking_nsxv3.common.synchronization [req-b328735e-df4b-4e6c-9e69-82454d55ae37 req-883a51f3-2328-4271-987c-f2d0a0d3d1c5 tempest-ServerRescueNegativeTestJSON-197938596 tempest-ServerRescueNegativeTestJSON-197938596-project-member] Enqueued Resource ID: fcc3c75c-0cae-4c7c-8f32-6c948e76880d with Priority: HIGHEST for action security_group_members [ 946.227169] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcc3c75c-0cae-4c7c-8f32-6c948e76880d with Priority: HIGHEST for action security_group_members [ 946.227552] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-fcc3c75c-0cae-4c7c-8f32-6c948e76880d taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.227683] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fcc3c75c-0cae-4c7c-8f32-6c948e76880d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.227754] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fcc3c75c-0cae-4c7c-8f32-6c948e76880d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.228122] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fcc3c75c-0cae-4c7c-8f32-6c948e76880d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.228305] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.228462] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.228534] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.228705] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.228794] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.228893] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fcc3c75c-0cae-4c7c-8f32-6c948e76880d',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.250837] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49e97029-e971-47d3-aa73-0fe54ba5d0b0 in Status: SUCCESS [ 946.250940] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49e97029-e971-47d3-aa73-0fe54ba5d0b0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.251177] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49e97029-e971-47d3-aa73-0fe54ba5d0b0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.251705] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49e97029-e971-47d3-aa73-0fe54ba5d0b0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.251705] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.251705] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.256360] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.256360] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.256360] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.256360] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49e97029-e971-47d3-aa73-0fe54ba5d0b0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.256360] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('49e97029-e971-47d3-aa73-0fe54ba5d0b0',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.256360] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49e97029-e971-47d3-aa73-0fe54ba5d0b0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.256360] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49e97029-e971-47d3-aa73-0fe54ba5d0b0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.256360] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.256360] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.256360] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.256360] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.256360] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.256360] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49e97029-e971-47d3-aa73-0fe54ba5d0b0',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.326394] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 981ce95b-4070-4d2e-ade9-6fe1b7239ddd with status ACTIVE [ 946.326663] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.326802] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.326886] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.327382] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.327490] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.328943] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.328943] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.328943] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.328943] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.328943] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.328943] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.328943] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.328943] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.329326] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.329326] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.329326] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 981ce95b-4070-4d2e-ade9-6fe1b7239ddd is going to be updated. [ 946.355165] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.355325] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.355400] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.355611] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.355858] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.355913] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-981ce95b-4070-4d2e-ade9-6fe1b7239ddd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.479027] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12c8b5a9-023e-43d6-a4a6-03004d0ac434 in Status: SUCCESS [ 946.479296] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12c8b5a9-023e-43d6-a4a6-03004d0ac434" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.479506] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12c8b5a9-023e-43d6-a4a6-03004d0ac434" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.479784] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12c8b5a9-023e-43d6-a4a6-03004d0ac434" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.480040] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.480193] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.480277] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.480541] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.480662] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.480787] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12c8b5a9-023e-43d6-a4a6-03004d0ac434',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.564331] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.564486] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.564559] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.564767] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.564856] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.564958] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 12c8b5a9-023e-43d6-a4a6-03004d0ac434 is going to be deleted. [ 946.634384] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.634549] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.634606] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.634867] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.634950] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.635106] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-12c8b5a9-023e-43d6-a4a6-03004d0ac434" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.735026] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.735026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.735026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.735026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.735026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.735026] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.735026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.735026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.735026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.735026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.735026] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fcc3c75c-0cae-4c7c-8f32-6c948e76880d already deleted. [ 946.735026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fcc3c75c-0cae-4c7c-8f32-6c948e76880d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.742146] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-553 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.742386] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-553" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.742555] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-553" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.742830] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-553" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.743156] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.743496] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.743671] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.743908] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.744116] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.744392] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 946.744552] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 946.744698] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 946.744839] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 946.745009] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 946.745205] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 946.745398] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 946.755693] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-49e97029-e971-47d3-aa73-0fe54ba5d0b0 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.755963] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49e97029-e971-47d3-aa73-0fe54ba5d0b0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.756208] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('49e97029-e971-47d3-aa73-0fe54ba5d0b0',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.779013] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 946.779171] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 946.779446] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 946.779563] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-553" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.779790] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-3c2fa847-d722-40a5-862f-b0d68a1499a8 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.780069] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-3c2fa847-d722-40a5-862f-b0d68a1499a8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.780160] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-3c2fa847-d722-40a5-862f-b0d68a1499a8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.780479] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-3c2fa847-d722-40a5-862f-b0d68a1499a8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.780625] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c2fa847-d722-40a5-862f-b0d68a1499a8',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.984033] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.984339] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.984339] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.984452] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.984542] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.984742] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.984846] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.985241] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.985760] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.985760] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.985760] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12c8b5a9-023e-43d6-a4a6-03004d0ac434 is going to be deleted. [ 947.016921] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.017120] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.017120] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.017296] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.017359] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.017467] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12c8b5a9-023e-43d6-a4a6-03004d0ac434" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.017623] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12c8b5a9-023e-43d6-a4a6-03004d0ac434" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.017784] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12c8b5a9-023e-43d6-a4a6-03004d0ac434" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.017939] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.018053] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.018110] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.018270] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.018315] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.018409] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12c8b5a9-023e-43d6-a4a6-03004d0ac434',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.259917] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('49e97029-e971-47d3-aa73-0fe54ba5d0b0',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.286025] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.286025] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.286025] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.286025] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.286025] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.286025] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 3c2fa847-d722-40a5-862f-b0d68a1499a8 not found, creating... [ 947.286025] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.286025] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.286025] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.286025] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.286025] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.286430] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.287205] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.288472] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.288903] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.289275] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.290167] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 3c2fa847-d722-40a5-862f-b0d68a1499a8 is going to be created. [ 947.312546] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.312902] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.313474] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.313739] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.314062] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.314342] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-3c2fa847-d722-40a5-862f-b0d68a1499a8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.407088] env[70392]: INFO networking_nsxv3.common.synchronization [req-443c26d2-b1cc-43d8-9a00-366a8480f1e9 req-97a664dc-30bc-4ec7-9f4a-6f3463b42a3b tempest-ServerTagsTestJSON-478540309 tempest-ServerTagsTestJSON-478540309-project-member] Enqueued Resource ID: 7fe12613-4be5-4b59-9116-6e8887356711 with Priority: HIGHEST for action security_group_members [ 947.407389] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fe12613-4be5-4b59-9116-6e8887356711 with Priority: HIGHEST for action security_group_members [ 947.407786] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fe12613-4be5-4b59-9116-6e8887356711 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.407982] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fe12613-4be5-4b59-9116-6e8887356711" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.408138] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fe12613-4be5-4b59-9116-6e8887356711" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.408447] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fe12613-4be5-4b59-9116-6e8887356711" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.409116] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.409293] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.411677] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.411677] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.411677] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.411677] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fe12613-4be5-4b59-9116-6e8887356711',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.520968] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.521226] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.521296] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.521506] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.521602] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.521809] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.521910] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.522040] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.522221] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.522301] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.522387] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12c8b5a9-023e-43d6-a4a6-03004d0ac434 already deleted. [ 947.522470] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12c8b5a9-023e-43d6-a4a6-03004d0ac434" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.762320] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.762458] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.762458] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.762668] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.762760] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.762869] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49e97029-e971-47d3-aa73-0fe54ba5d0b0 is going to be updated. [ 947.813277] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.813277] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.813277] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.813277] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.813277] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.831528] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49e97029-e971-47d3-aa73-0fe54ba5d0b0 in Status: IN_PROGRESS for 2s [ 947.914889] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.915108] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.915405] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.915517] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.916508] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.916508] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.916508] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.916508] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.916508] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.916926] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.916926] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fe12613-4be5-4b59-9116-6e8887356711 is going to be updated. [ 947.975623] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.975879] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.975994] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.976333] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.976554] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.988282] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fe12613-4be5-4b59-9116-6e8887356711 in Status: IN_PROGRESS for 2s [ 948.110522] env[70392]: INFO networking_nsxv3.common.synchronization [req-b328735e-df4b-4e6c-9e69-82454d55ae37 req-ddf6c34a-dba6-4739-9a3a-7b5b613eb7e3 service nova] Enqueued Resource ID: fcc3c75c-0cae-4c7c-8f32-6c948e76880d with Priority: HIGHEST for action security_group_rules [ 948.110793] env[70392]: INFO networking_nsxv3.common.synchronization [req-b328735e-df4b-4e6c-9e69-82454d55ae37 req-ddf6c34a-dba6-4739-9a3a-7b5b613eb7e3 service nova] Enqueued Resource ID: fcc3c75c-0cae-4c7c-8f32-6c948e76880d with Priority: HIGHEST for action security_group_members [ 948.110860] env[70392]: INFO networking_nsxv3.common.synchronization [req-b328735e-df4b-4e6c-9e69-82454d55ae37 req-ddf6c34a-dba6-4739-9a3a-7b5b613eb7e3 service nova] Enqueued Resource ID: 3c2fa847-d722-40a5-862f-b0d68a1499a8 with Priority: HIGHEST for action port [ 948.111136] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcc3c75c-0cae-4c7c-8f32-6c948e76880d with Priority: HIGHEST for action security_group_rules [ 948.111259] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcc3c75c-0cae-4c7c-8f32-6c948e76880d with Priority: HIGHEST for action security_group_members [ 948.111359] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c2fa847-d722-40a5-862f-b0d68a1499a8 with Priority: HIGHEST for action port [ 948.112074] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fcc3c75c-0cae-4c7c-8f32-6c948e76880d taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.112229] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fcc3c75c-0cae-4c7c-8f32-6c948e76880d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.112336] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fcc3c75c-0cae-4c7c-8f32-6c948e76880d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.112489] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fcc3c75c-0cae-4c7c-8f32-6c948e76880d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.112568] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fcc3c75c-0cae-4c7c-8f32-6c948e76880d',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.113516] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-fcc3c75c-0cae-4c7c-8f32-6c948e76880d taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.113625] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fcc3c75c-0cae-4c7c-8f32-6c948e76880d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.113688] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fcc3c75c-0cae-4c7c-8f32-6c948e76880d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.113855] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fcc3c75c-0cae-4c7c-8f32-6c948e76880d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.113997] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.114096] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.114154] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.114345] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.114443] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.114533] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fcc3c75c-0cae-4c7c-8f32-6c948e76880d',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.117401] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-3c2fa847-d722-40a5-862f-b0d68a1499a8 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.117401] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3c2fa847-d722-40a5-862f-b0d68a1499a8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.117401] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3c2fa847-d722-40a5-862f-b0d68a1499a8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.117401] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3c2fa847-d722-40a5-862f-b0d68a1499a8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.117401] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c2fa847-d722-40a5-862f-b0d68a1499a8',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.618433] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-fcc3c75c-0cae-4c7c-8f32-6c948e76880d taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.618661] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fcc3c75c-0cae-4c7c-8f32-6c948e76880d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.618856] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fcc3c75c-0cae-4c7c-8f32-6c948e76880d',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.620032] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3c2fa847-d722-40a5-862f-b0d68a1499a8 with status ACTIVE [ 948.620264] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.620473] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.620549] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.620735] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.620871] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.621514] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.621626] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.621703] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.621872] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.621960] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.622211] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.622383] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.622425] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.622807] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.622807] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.622807] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3c2fa847-d722-40a5-862f-b0d68a1499a8 is going to be updated. [ 948.654495] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.654664] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.654719] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.654908] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.655071] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.655238] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3c2fa847-d722-40a5-862f-b0d68a1499a8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.802474] env[70392]: INFO networking_nsxv3.common.synchronization [req-95fb94d7-bfb7-44e6-bb9a-6721f3994147 req-91633b46-56ac-4e2d-b5cd-d73260732439 tempest-ImagesTestJSON-499820929 tempest-ImagesTestJSON-499820929-project-member] Enqueued Resource ID: bca01ddc-73d5-4856-bbff-aefad642492a with Priority: HIGHEST for action security_group_members [ 948.802474] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bca01ddc-73d5-4856-bbff-aefad642492a with Priority: HIGHEST for action security_group_members [ 948.802738] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-bca01ddc-73d5-4856-bbff-aefad642492a taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.802870] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.802922] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.803405] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.803587] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.803700] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.803767] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.803943] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.804111] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.804159] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bca01ddc-73d5-4856-bbff-aefad642492a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.125614] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fcc3c75c-0cae-4c7c-8f32-6c948e76880d',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.311481] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.311701] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.311778] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.312009] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.312268] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.312503] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.312613] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.312665] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.312836] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.312915] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.312998] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bca01ddc-73d5-4856-bbff-aefad642492a is going to be updated. [ 949.316608] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-153 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.316790] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-153" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.316938] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-153" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.320355] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-153" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.320912] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.320912] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.321057] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.321246] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.321459] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.321765] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 949.321897] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 949.322070] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 949.322285] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 949.322509] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 949.322721] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 949.322972] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 949.346944] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.347058] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.347095] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.347299] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.347459] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.353451] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 949.353691] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 949.353871] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 949.354093] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-153" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.354743] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-2c38d1b0-b175-458e-9af8-59ab4a949905 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.354743] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-2c38d1b0-b175-458e-9af8-59ab4a949905" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.354889] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-2c38d1b0-b175-458e-9af8-59ab4a949905" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.355334] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-2c38d1b0-b175-458e-9af8-59ab4a949905" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.355562] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c38d1b0-b175-458e-9af8-59ab4a949905',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.358070] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bca01ddc-73d5-4856-bbff-aefad642492a in Status: IN_PROGRESS for 2s [ 949.628042] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.628042] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.628204] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.628316] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.628418] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.628509] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fcc3c75c-0cae-4c7c-8f32-6c948e76880d is going to be created. [ 949.656164] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.656164] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.656164] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.656164] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.656164] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.666056] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fcc3c75c-0cae-4c7c-8f32-6c948e76880d in Status: UNINITIALIZED for 2s [ 949.841974] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49e97029-e971-47d3-aa73-0fe54ba5d0b0 in Status: SUCCESS [ 949.845257] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49e97029-e971-47d3-aa73-0fe54ba5d0b0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.845257] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49e97029-e971-47d3-aa73-0fe54ba5d0b0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.845257] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49e97029-e971-47d3-aa73-0fe54ba5d0b0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.845257] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.845257] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.845257] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.845257] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.845257] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.845257] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49e97029-e971-47d3-aa73-0fe54ba5d0b0',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.862022] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.862022] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.862022] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.862022] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.862022] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.862022] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 2c38d1b0-b175-458e-9af8-59ab4a949905 not found, creating... [ 949.862022] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.862022] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.862022] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.862022] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.862022] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.862512] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.862512] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.862512] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.862512] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.862512] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.862512] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 2c38d1b0-b175-458e-9af8-59ab4a949905 is going to be created. [ 949.883258] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.883694] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.883828] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.884189] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.884459] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.884731] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-2c38d1b0-b175-458e-9af8-59ab4a949905" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.006929] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fe12613-4be5-4b59-9116-6e8887356711 in Status: SUCCESS [ 950.006929] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fe12613-4be5-4b59-9116-6e8887356711 deletion is rescheduled due to dependency. [ 950.006929] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fe12613-4be5-4b59-9116-6e8887356711" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.347254] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('49e97029-e971-47d3-aa73-0fe54ba5d0b0',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.850311] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('49e97029-e971-47d3-aa73-0fe54ba5d0b0',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.880049] env[70392]: INFO networking_nsxv3.common.synchronization [req-95fb94d7-bfb7-44e6-bb9a-6721f3994147 req-b32e2f5a-09e0-4be6-8105-02561f0556aa service nova] Enqueued Resource ID: bca01ddc-73d5-4856-bbff-aefad642492a with Priority: HIGHEST for action security_group_rules [ 950.880364] env[70392]: INFO networking_nsxv3.common.synchronization [req-95fb94d7-bfb7-44e6-bb9a-6721f3994147 req-b32e2f5a-09e0-4be6-8105-02561f0556aa service nova] Enqueued Resource ID: bca01ddc-73d5-4856-bbff-aefad642492a with Priority: HIGHEST for action security_group_members [ 950.880554] env[70392]: INFO networking_nsxv3.common.synchronization [req-95fb94d7-bfb7-44e6-bb9a-6721f3994147 req-b32e2f5a-09e0-4be6-8105-02561f0556aa service nova] Enqueued Resource ID: 2c38d1b0-b175-458e-9af8-59ab4a949905 with Priority: HIGHEST for action port [ 950.881307] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bca01ddc-73d5-4856-bbff-aefad642492a with Priority: HIGHEST for action security_group_rules [ 950.881458] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bca01ddc-73d5-4856-bbff-aefad642492a with Priority: HIGHEST for action security_group_members [ 950.881557] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c38d1b0-b175-458e-9af8-59ab4a949905 with Priority: HIGHEST for action port [ 950.881835] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bca01ddc-73d5-4856-bbff-aefad642492a taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.881961] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.884845] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.885364] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.885536] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bca01ddc-73d5-4856-bbff-aefad642492a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.887046] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-bca01ddc-73d5-4856-bbff-aefad642492a taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.887361] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.887983] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c38d1b0-b175-458e-9af8-59ab4a949905 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.887983] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c38d1b0-b175-458e-9af8-59ab4a949905" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.888239] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c38d1b0-b175-458e-9af8-59ab4a949905" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.888437] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c38d1b0-b175-458e-9af8-59ab4a949905" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.888573] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c38d1b0-b175-458e-9af8-59ab4a949905',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.353591] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.357306] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.357306] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.357306] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.357306] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.357306] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49e97029-e971-47d3-aa73-0fe54ba5d0b0 is going to be updated. [ 951.371596] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bca01ddc-73d5-4856-bbff-aefad642492a in Status: SUCCESS [ 951.372315] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bca01ddc-73d5-4856-bbff-aefad642492a deletion is rescheduled due to dependency. [ 951.372609] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.372909] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.373229] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.373501] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.373764] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.373962] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.374245] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.374415] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.374625] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bca01ddc-73d5-4856-bbff-aefad642492a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.394023] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-bca01ddc-73d5-4856-bbff-aefad642492a taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.394023] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.394023] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2c38d1b0-b175-458e-9af8-59ab4a949905 with status ACTIVE [ 951.394023] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.394023] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.394023] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.394023] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.394023] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.394023] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.394023] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.394023] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.394023] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.394023] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.394023] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.394651] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.394651] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.394651] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.394651] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.394651] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2c38d1b0-b175-458e-9af8-59ab4a949905 is going to be updated. [ 951.396267] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.403690] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.403690] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.403690] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.403690] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.412497] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49e97029-e971-47d3-aa73-0fe54ba5d0b0 in Status: IN_PROGRESS for 2s [ 951.424141] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.424141] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.424141] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.425262] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.425262] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.425262] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c38d1b0-b175-458e-9af8-59ab4a949905" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.507630] env[70392]: INFO networking_nsxv3.common.synchronization [None req-27c31e6d-b33b-44e8-9642-0a3a54f7cc0c tempest-AttachVolumeNegativeTest-772339566 tempest-AttachVolumeNegativeTest-772339566-project-member] Enqueued Resource ID: 43327972-df6d-4e69-b782-fda3a340af0a with Priority: HIGHEST for action security_group_rules [ 951.508259] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43327972-df6d-4e69-b782-fda3a340af0a with Priority: HIGHEST for action security_group_rules [ 951.508717] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-43327972-df6d-4e69-b782-fda3a340af0a taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.508717] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-43327972-df6d-4e69-b782-fda3a340af0a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.508902] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-43327972-df6d-4e69-b782-fda3a340af0a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.508985] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-43327972-df6d-4e69-b782-fda3a340af0a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.509198] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('43327972-df6d-4e69-b782-fda3a340af0a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.633773] env[70392]: INFO networking_nsxv3.common.synchronization [None req-656bdf1a-7d71-4598-abce-7268c82d74d2 tempest-AttachVolumeNegativeTest-772339566 tempest-AttachVolumeNegativeTest-772339566-project-member] Enqueued Resource ID: 43327972-df6d-4e69-b782-fda3a340af0a with Priority: HIGHEST for action security_group_rules [ 951.634323] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43327972-df6d-4e69-b782-fda3a340af0a with Priority: HIGHEST for action security_group_rules [ 951.634617] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-43327972-df6d-4e69-b782-fda3a340af0a taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.634714] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-43327972-df6d-4e69-b782-fda3a340af0a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.685061] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fcc3c75c-0cae-4c7c-8f32-6c948e76880d in Status: SUCCESS [ 951.688252] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fcc3c75c-0cae-4c7c-8f32-6c948e76880d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.688252] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fcc3c75c-0cae-4c7c-8f32-6c948e76880d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.688252] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fcc3c75c-0cae-4c7c-8f32-6c948e76880d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.688252] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.688252] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.688252] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.688252] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.688252] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.688252] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fcc3c75c-0cae-4c7c-8f32-6c948e76880d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.688252] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fcc3c75c-0cae-4c7c-8f32-6c948e76880d',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.878016] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bca01ddc-73d5-4856-bbff-aefad642492a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.043925] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.043925] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.043925] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.043925] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.043925] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.043925] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 43327972-df6d-4e69-b782-fda3a340af0a already deleted. [ 952.043925] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-43327972-df6d-4e69-b782-fda3a340af0a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.043925] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-43327972-df6d-4e69-b782-fda3a340af0a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.043925] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-43327972-df6d-4e69-b782-fda3a340af0a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.043925] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('43327972-df6d-4e69-b782-fda3a340af0a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.140053] env[70392]: INFO networking_nsxv3.common.synchronization [req-de83d22b-dd16-489b-89f5-7cd2bebc8948 req-6273d7c4-2429-43c7-ba0e-a7a762da02f0 tempest-ServersWithSpecificFlavorTestJSON-1944551370 tempest-ServersWithSpecificFlavorTestJSON-1944551370-project-member] Enqueued Resource ID: 7f78f149-d978-4089-8aa8-d480e7d7bb61 with Priority: HIGHEST for action security_group_members [ 952.140053] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f78f149-d978-4089-8aa8-d480e7d7bb61 with Priority: HIGHEST for action security_group_members [ 952.141028] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f78f149-d978-4089-8aa8-d480e7d7bb61 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.142094] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f78f149-d978-4089-8aa8-d480e7d7bb61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.142510] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f78f149-d978-4089-8aa8-d480e7d7bb61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.142924] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f78f149-d978-4089-8aa8-d480e7d7bb61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.143293] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.145290] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.145290] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.145290] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.145290] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.145290] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f78f149-d978-4089-8aa8-d480e7d7bb61',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.190883] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fcc3c75c-0cae-4c7c-8f32-6c948e76880d',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.380235] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bca01ddc-73d5-4856-bbff-aefad642492a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.566724] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.566956] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.566956] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.567163] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.567254] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.567350] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 43327972-df6d-4e69-b782-fda3a340af0a already deleted. [ 952.567430] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-43327972-df6d-4e69-b782-fda3a340af0a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.647142] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.647142] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.647142] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.647142] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.647408] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.647408] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.647485] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.647516] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.647670] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.647751] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.647830] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f78f149-d978-4089-8aa8-d480e7d7bb61 is going to be updated. [ 952.649972] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-934 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.650185] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-934" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.650345] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-934" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.650588] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-934" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.650849] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.651016] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.651139] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.651355] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.651491] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.651702] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 952.651819] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 952.651935] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 952.652058] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 952.652520] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 952.652712] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 952.652859] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 952.674884] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 952.675349] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 952.675535] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 952.675728] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-934" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.676072] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-fe0a4026-a32e-403d-9418-b6de5c477144 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.676254] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-fe0a4026-a32e-403d-9418-b6de5c477144" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.676379] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-fe0a4026-a32e-403d-9418-b6de5c477144" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.676712] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-fe0a4026-a32e-403d-9418-b6de5c477144" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.676858] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe0a4026-a32e-403d-9418-b6de5c477144',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.693508] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.693508] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.693508] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.693724] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.693876] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.701668] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fcc3c75c-0cae-4c7c-8f32-6c948e76880d: rpc.has_security_group_logging(os_id): False [ 952.708789] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f78f149-d978-4089-8aa8-d480e7d7bb61 in Status: IN_PROGRESS for 2s [ 952.728329] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.728532] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.728532] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.728710] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.728793] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.729048] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.729149] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.729299] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.729349] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.729428] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.729518] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fcc3c75c-0cae-4c7c-8f32-6c948e76880d is going to be created. [ 952.868502] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.868650] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.868723] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.869016] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.869126] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.889924] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.890330] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.890330] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.890487] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.890522] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.890621] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bca01ddc-73d5-4856-bbff-aefad642492a is going to be updated. [ 952.913207] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fcc3c75c-0cae-4c7c-8f32-6c948e76880d in Status: IN_PROGRESS for 2s [ 952.956089] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.956328] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.956328] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.956526] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.956670] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.971256] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bca01ddc-73d5-4856-bbff-aefad642492a in Status: IN_PROGRESS for 2s [ 953.181698] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.181947] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.182166] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.182606] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.182837] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.183097] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port fe0a4026-a32e-403d-9418-b6de5c477144 not found, creating... [ 953.183558] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.183843] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.184022] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.188440] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.188694] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.189164] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.189408] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.189556] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.189857] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.190067] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.190231] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: fe0a4026-a32e-403d-9418-b6de5c477144 is going to be created. [ 953.229906] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.229906] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.230172] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.230374] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.230524] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.230766] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-fe0a4026-a32e-403d-9418-b6de5c477144" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.424461] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49e97029-e971-47d3-aa73-0fe54ba5d0b0 in Status: SUCCESS [ 953.424871] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49e97029-e971-47d3-aa73-0fe54ba5d0b0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.424871] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49e97029-e971-47d3-aa73-0fe54ba5d0b0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.425192] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49e97029-e971-47d3-aa73-0fe54ba5d0b0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.426019] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.426019] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.426019] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.426019] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.426019] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.426019] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49e97029-e971-47d3-aa73-0fe54ba5d0b0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.426359] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-49e97029-e971-47d3-aa73-0fe54ba5d0b0 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.426359] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49e97029-e971-47d3-aa73-0fe54ba5d0b0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.426359] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49e97029-e971-47d3-aa73-0fe54ba5d0b0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.426471] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49e97029-e971-47d3-aa73-0fe54ba5d0b0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.426607] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.426706] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.426765] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.426935] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.427011] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.427100] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49e97029-e971-47d3-aa73-0fe54ba5d0b0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.427189] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('49e97029-e971-47d3-aa73-0fe54ba5d0b0',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.934257] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 49e97029-e971-47d3-aa73-0fe54ba5d0b0: rpc.has_security_group_logging(os_id): False [ 953.955567] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.955798] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.955906] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.956271] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.956271] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.956496] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.956818] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.956818] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.956818] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.957243] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.957243] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.957243] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.957243] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.957405] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.957523] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.957647] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.957757] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.957821] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.957969] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.958092] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.958142] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49e97029-e971-47d3-aa73-0fe54ba5d0b0 is going to be created. [ 953.963484] env[70392]: INFO networking_nsxv3.common.synchronization [req-de83d22b-dd16-489b-89f5-7cd2bebc8948 req-c04e9199-8171-47a5-b276-a497fb492a32 service nova] Enqueued Resource ID: 7f78f149-d978-4089-8aa8-d480e7d7bb61 with Priority: HIGHEST for action security_group_rules [ 953.963746] env[70392]: INFO networking_nsxv3.common.synchronization [req-de83d22b-dd16-489b-89f5-7cd2bebc8948 req-c04e9199-8171-47a5-b276-a497fb492a32 service nova] Enqueued Resource ID: 7f78f149-d978-4089-8aa8-d480e7d7bb61 with Priority: HIGHEST for action security_group_members [ 953.963813] env[70392]: INFO networking_nsxv3.common.synchronization [req-de83d22b-dd16-489b-89f5-7cd2bebc8948 req-c04e9199-8171-47a5-b276-a497fb492a32 service nova] Enqueued Resource ID: fe0a4026-a32e-403d-9418-b6de5c477144 with Priority: HIGHEST for action port [ 953.964453] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f78f149-d978-4089-8aa8-d480e7d7bb61 with Priority: HIGHEST for action security_group_rules [ 953.964582] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f78f149-d978-4089-8aa8-d480e7d7bb61 with Priority: HIGHEST for action security_group_members [ 953.964689] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe0a4026-a32e-403d-9418-b6de5c477144 with Priority: HIGHEST for action port [ 953.965240] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f78f149-d978-4089-8aa8-d480e7d7bb61 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.965362] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f78f149-d978-4089-8aa8-d480e7d7bb61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.965433] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f78f149-d978-4089-8aa8-d480e7d7bb61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.965627] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f78f149-d978-4089-8aa8-d480e7d7bb61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.965706] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f78f149-d978-4089-8aa8-d480e7d7bb61',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.967066] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f78f149-d978-4089-8aa8-d480e7d7bb61 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.967066] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f78f149-d978-4089-8aa8-d480e7d7bb61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.967066] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe0a4026-a32e-403d-9418-b6de5c477144 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.967284] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe0a4026-a32e-403d-9418-b6de5c477144" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.967284] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe0a4026-a32e-403d-9418-b6de5c477144" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.967343] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe0a4026-a32e-403d-9418-b6de5c477144" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.967440] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe0a4026-a32e-403d-9418-b6de5c477144',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.023242] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.023431] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.023503] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.023715] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.023912] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.037218] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49e97029-e971-47d3-aa73-0fe54ba5d0b0 in Status: IN_PROGRESS for 2s [ 954.469628] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fe0a4026-a32e-403d-9418-b6de5c477144 with status ACTIVE [ 954.469879] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.470042] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.470129] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.470344] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.470436] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.470620] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.470723] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.470785] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.470927] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.471008] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.471200] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.471294] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.471357] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.471498] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.471573] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.471657] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fe0a4026-a32e-403d-9418-b6de5c477144 is going to be updated. [ 954.472872] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f78f149-d978-4089-8aa8-d480e7d7bb61 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.472970] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f78f149-d978-4089-8aa8-d480e7d7bb61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.497739] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.497876] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.497947] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.498198] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.498343] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.498497] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe0a4026-a32e-403d-9418-b6de5c477144" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.718769] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f78f149-d978-4089-8aa8-d480e7d7bb61 in Status: SUCCESS [ 954.718971] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f78f149-d978-4089-8aa8-d480e7d7bb61 deletion is rescheduled due to dependency. [ 954.719117] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f78f149-d978-4089-8aa8-d480e7d7bb61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.719285] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f78f149-d978-4089-8aa8-d480e7d7bb61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.719504] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f78f149-d978-4089-8aa8-d480e7d7bb61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.719704] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.719805] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.719870] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.720114] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.720210] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.720451] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f78f149-d978-4089-8aa8-d480e7d7bb61',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.929064] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fcc3c75c-0cae-4c7c-8f32-6c948e76880d in Status: SUCCESS [ 954.929458] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fcc3c75c-0cae-4c7c-8f32-6c948e76880d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.980846] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bca01ddc-73d5-4856-bbff-aefad642492a in Status: SUCCESS [ 954.981220] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.981411] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.981661] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.981860] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.982748] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.982748] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.982748] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.982748] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.982748] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.982748] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bca01ddc-73d5-4856-bbff-aefad642492a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.222698] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7f78f149-d978-4089-8aa8-d480e7d7bb61',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.485263] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-bca01ddc-73d5-4856-bbff-aefad642492a taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.485784] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.485784] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.485784] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.485909] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.485967] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.486011] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.486164] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.486251] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.486779] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.486779] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-bca01ddc-73d5-4856-bbff-aefad642492a taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.486779] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.486779] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.486779] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.487036] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.487036] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.487036] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.487209] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.487242] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.487312] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.487604] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bca01ddc-73d5-4856-bbff-aefad642492a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.727492] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7f78f149-d978-4089-8aa8-d480e7d7bb61',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.991110] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bca01ddc-73d5-4856-bbff-aefad642492a: rpc.has_security_group_logging(os_id): False [ 956.012610] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.012775] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.012835] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.013037] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.013131] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.013351] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.013446] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.013498] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.013666] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.013741] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.013903] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.013988] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.014053] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.014268] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.014760] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.014987] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.015195] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.015356] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.015437] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.015495] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.015568] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bca01ddc-73d5-4856-bbff-aefad642492a is going to be updated. [ 956.049486] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49e97029-e971-47d3-aa73-0fe54ba5d0b0 in Status: SUCCESS [ 956.049808] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49e97029-e971-47d3-aa73-0fe54ba5d0b0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.050025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49e97029-e971-47d3-aa73-0fe54ba5d0b0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.050252] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49e97029-e971-47d3-aa73-0fe54ba5d0b0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.050354] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49e97029-e971-47d3-aa73-0fe54ba5d0b0',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.084553] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.085773] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.085773] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.085773] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.085773] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.108641] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bca01ddc-73d5-4856-bbff-aefad642492a in Status: IN_PROGRESS for 2s [ 956.230127] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.230322] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.230389] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.230878] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.230878] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.230878] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f78f149-d978-4089-8aa8-d480e7d7bb61 is going to be updated. [ 956.261863] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.262024] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.262096] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.262389] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.262538] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.272647] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f78f149-d978-4089-8aa8-d480e7d7bb61 in Status: IN_PROGRESS for 2s [ 956.554643] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-49e97029-e971-47d3-aa73-0fe54ba5d0b0 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.554643] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49e97029-e971-47d3-aa73-0fe54ba5d0b0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.554643] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49e97029-e971-47d3-aa73-0fe54ba5d0b0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.554643] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49e97029-e971-47d3-aa73-0fe54ba5d0b0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.554643] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.554643] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.554643] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.554643] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.554643] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.554643] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49e97029-e971-47d3-aa73-0fe54ba5d0b0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.554643] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('49e97029-e971-47d3-aa73-0fe54ba5d0b0',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.057953] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-49e97029-e971-47d3-aa73-0fe54ba5d0b0 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.058151] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49e97029-e971-47d3-aa73-0fe54ba5d0b0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.058222] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49e97029-e971-47d3-aa73-0fe54ba5d0b0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.058437] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49e97029-e971-47d3-aa73-0fe54ba5d0b0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.058607] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.058729] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.058829] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.058988] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.059114] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.059205] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49e97029-e971-47d3-aa73-0fe54ba5d0b0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.059394] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-49e97029-e971-47d3-aa73-0fe54ba5d0b0 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.059505] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49e97029-e971-47d3-aa73-0fe54ba5d0b0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.059570] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49e97029-e971-47d3-aa73-0fe54ba5d0b0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.059714] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49e97029-e971-47d3-aa73-0fe54ba5d0b0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.059852] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.059943] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.060014] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.060178] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.060253] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.060334] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49e97029-e971-47d3-aa73-0fe54ba5d0b0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.060423] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('49e97029-e971-47d3-aa73-0fe54ba5d0b0',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.197986] env[70392]: INFO networking_nsxv3.common.synchronization [req-7fdfe644-5561-4274-8814-78dbe5011379 req-fe98319c-961b-4002-9511-44be53c49563 tempest-AttachInterfacesTestJSON-2046649887 tempest-AttachInterfacesTestJSON-2046649887-project-member] Enqueued Resource ID: 40ebe9d4-d512-4967-99a6-0a7cf11dc1cd with Priority: HIGHEST for action security_group_members [ 957.199694] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40ebe9d4-d512-4967-99a6-0a7cf11dc1cd with Priority: HIGHEST for action security_group_members [ 957.200127] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-40ebe9d4-d512-4967-99a6-0a7cf11dc1cd taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.200266] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40ebe9d4-d512-4967-99a6-0a7cf11dc1cd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.200391] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40ebe9d4-d512-4967-99a6-0a7cf11dc1cd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.200631] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40ebe9d4-d512-4967-99a6-0a7cf11dc1cd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.200799] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.200899] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.200964] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.201142] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.201230] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.201329] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40ebe9d4-d512-4967-99a6-0a7cf11dc1cd',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.564717] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 49e97029-e971-47d3-aa73-0fe54ba5d0b0: rpc.has_security_group_logging(os_id): False [ 957.583395] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.583395] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.583395] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.583395] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.583395] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.583395] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.583395] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.583395] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.583395] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.583395] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.585666] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.585989] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.586155] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.586401] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.586563] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.587137] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.587396] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.587546] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.590011] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.590011] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.590011] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49e97029-e971-47d3-aa73-0fe54ba5d0b0 is going to be updated. [ 957.651254] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.651383] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.651439] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.653016] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.653016] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.665975] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49e97029-e971-47d3-aa73-0fe54ba5d0b0 in Status: IN_PROGRESS for 2s [ 957.705995] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.706204] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.706335] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.706612] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.706791] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.706948] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.707538] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.707538] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.707538] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.707538] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.707538] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40ebe9d4-d512-4967-99a6-0a7cf11dc1cd already deleted. [ 957.707538] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40ebe9d4-d512-4967-99a6-0a7cf11dc1cd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.858187] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-328 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.858455] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.858628] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.858922] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.859311] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.859483] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.859605] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.859858] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.860225] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.860305] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 957.860421] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 957.860882] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 957.860882] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 957.860882] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 957.860882] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 957.861052] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 957.881476] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 957.881669] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 957.881801] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 957.881993] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.882542] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-46bdb8ef-6ce7-4a20-a664-791820927504 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.882797] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-46bdb8ef-6ce7-4a20-a664-791820927504" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.882917] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-46bdb8ef-6ce7-4a20-a664-791820927504" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.883367] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-46bdb8ef-6ce7-4a20-a664-791820927504" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.883432] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('46bdb8ef-6ce7-4a20-a664-791820927504',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.125060] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bca01ddc-73d5-4856-bbff-aefad642492a in Status: SUCCESS [ 958.125306] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.284404] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f78f149-d978-4089-8aa8-d480e7d7bb61 in Status: SUCCESS [ 958.285073] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f78f149-d978-4089-8aa8-d480e7d7bb61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.285073] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f78f149-d978-4089-8aa8-d480e7d7bb61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.285073] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f78f149-d978-4089-8aa8-d480e7d7bb61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.285220] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.285329] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.285472] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.285635] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.285714] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.285799] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f78f149-d978-4089-8aa8-d480e7d7bb61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.285902] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7f78f149-d978-4089-8aa8-d480e7d7bb61',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.386528] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.386933] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.387159] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.387552] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.387831] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.388054] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 46bdb8ef-6ce7-4a20-a664-791820927504 not found, creating... [ 958.388419] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.388608] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.388757] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.389015] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.391039] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.391269] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.391611] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.391798] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.392062] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.393160] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.393361] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 46bdb8ef-6ce7-4a20-a664-791820927504 is going to be created. [ 958.417897] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.418159] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.418282] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.418581] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.418819] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.419064] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-46bdb8ef-6ce7-4a20-a664-791820927504" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.788072] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7f78f149-d978-4089-8aa8-d480e7d7bb61',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.248053] env[70392]: INFO networking_nsxv3.common.synchronization [req-7fdfe644-5561-4274-8814-78dbe5011379 req-bfc349c4-5e67-4a56-8696-2d1e4f067b88 service nova] Enqueued Resource ID: 40ebe9d4-d512-4967-99a6-0a7cf11dc1cd with Priority: HIGHEST for action security_group_rules [ 959.248053] env[70392]: INFO networking_nsxv3.common.synchronization [req-7fdfe644-5561-4274-8814-78dbe5011379 req-bfc349c4-5e67-4a56-8696-2d1e4f067b88 service nova] Enqueued Resource ID: 40ebe9d4-d512-4967-99a6-0a7cf11dc1cd with Priority: HIGHEST for action security_group_members [ 959.248053] env[70392]: INFO networking_nsxv3.common.synchronization [req-7fdfe644-5561-4274-8814-78dbe5011379 req-bfc349c4-5e67-4a56-8696-2d1e4f067b88 service nova] Enqueued Resource ID: 46bdb8ef-6ce7-4a20-a664-791820927504 with Priority: HIGHEST for action port [ 959.248053] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40ebe9d4-d512-4967-99a6-0a7cf11dc1cd with Priority: HIGHEST for action security_group_rules [ 959.248053] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40ebe9d4-d512-4967-99a6-0a7cf11dc1cd with Priority: HIGHEST for action security_group_members [ 959.248053] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46bdb8ef-6ce7-4a20-a664-791820927504 with Priority: HIGHEST for action port [ 959.248053] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40ebe9d4-d512-4967-99a6-0a7cf11dc1cd taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.248053] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40ebe9d4-d512-4967-99a6-0a7cf11dc1cd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.248053] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40ebe9d4-d512-4967-99a6-0a7cf11dc1cd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.251039] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40ebe9d4-d512-4967-99a6-0a7cf11dc1cd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.251039] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40ebe9d4-d512-4967-99a6-0a7cf11dc1cd',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.251039] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-40ebe9d4-d512-4967-99a6-0a7cf11dc1cd taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.251039] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40ebe9d4-d512-4967-99a6-0a7cf11dc1cd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.251039] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40ebe9d4-d512-4967-99a6-0a7cf11dc1cd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.251039] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40ebe9d4-d512-4967-99a6-0a7cf11dc1cd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.251039] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.251039] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.251039] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.251039] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.251039] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.251039] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40ebe9d4-d512-4967-99a6-0a7cf11dc1cd',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.251718] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-46bdb8ef-6ce7-4a20-a664-791820927504 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.251718] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-46bdb8ef-6ce7-4a20-a664-791820927504" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.251718] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-46bdb8ef-6ce7-4a20-a664-791820927504" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.251718] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-46bdb8ef-6ce7-4a20-a664-791820927504" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.251718] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('46bdb8ef-6ce7-4a20-a664-791820927504',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.291323] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7f78f149-d978-4089-8aa8-d480e7d7bb61: rpc.has_security_group_logging(os_id): False [ 959.310971] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.311184] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.311288] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.311649] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.311649] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.311908] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.312033] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.312100] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.312289] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.312407] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.312461] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f78f149-d978-4089-8aa8-d480e7d7bb61 is going to be updated. [ 959.386107] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.386245] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.386291] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.386489] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.386640] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.410023] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f78f149-d978-4089-8aa8-d480e7d7bb61 in Status: IN_PROGRESS for 2s [ 959.679214] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49e97029-e971-47d3-aa73-0fe54ba5d0b0 in Status: SUCCESS [ 959.679474] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49e97029-e971-47d3-aa73-0fe54ba5d0b0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.753160] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-40ebe9d4-d512-4967-99a6-0a7cf11dc1cd taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.753321] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40ebe9d4-d512-4967-99a6-0a7cf11dc1cd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.755028] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('40ebe9d4-d512-4967-99a6-0a7cf11dc1cd',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.755667] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 46bdb8ef-6ce7-4a20-a664-791820927504 with status ACTIVE [ 959.755849] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.755960] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.756038] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.756237] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.759718] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.759718] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.759718] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.759718] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.759718] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.759718] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.759718] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.759718] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.759718] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.759718] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.759718] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.759718] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 46bdb8ef-6ce7-4a20-a664-791820927504 is going to be updated. [ 959.782178] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.782378] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.782439] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.782645] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.782777] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.782934] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-46bdb8ef-6ce7-4a20-a664-791820927504" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.974292] env[70392]: INFO networking_nsxv3.common.synchronization [req-b50fb22d-8996-45b3-b13d-f2c802f96d08 req-1f49efc4-08fa-4f91-a9c7-be34f8912015 tempest-ServersAdminTestJSON-721710769 tempest-ServersAdminTestJSON-721710769-project-member] Enqueued Resource ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 with Priority: HIGHEST for action security_group_members [ 959.974872] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 with Priority: HIGHEST for action security_group_members [ 959.975194] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-f54639a3-c11e-4833-b47a-e0b477c46dd5 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.975317] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.975386] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.975650] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.975809] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.975908] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.975969] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.976138] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.976223] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.976316] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f54639a3-c11e-4833-b47a-e0b477c46dd5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.259510] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('40ebe9d4-d512-4967-99a6-0a7cf11dc1cd',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.444417] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-880 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.444643] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-880" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.444788] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-880" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.445129] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-880" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.445399] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.445559] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.445678] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.445898] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.446055] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.446354] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 960.446480] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 960.446597] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 960.446711] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 960.446827] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 960.446939] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 960.447094] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 960.468535] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 960.468732] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 960.468876] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 960.469076] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-880" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.469402] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-cb7912d5-59fd-44f6-8175-cbc4d736aa75 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.469580] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-cb7912d5-59fd-44f6-8175-cbc4d736aa75" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.469846] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-cb7912d5-59fd-44f6-8175-cbc4d736aa75" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.470088] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-cb7912d5-59fd-44f6-8175-cbc4d736aa75" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.470332] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb7912d5-59fd-44f6-8175-cbc4d736aa75',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.478087] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f54639a3-c11e-4833-b47a-e0b477c46dd5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.764029] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.764316] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.764316] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.764598] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.764748] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.764919] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40ebe9d4-d512-4967-99a6-0a7cf11dc1cd is going to be created. [ 960.789875] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.792287] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.792287] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.792287] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.792287] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.801722] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40ebe9d4-d512-4967-99a6-0a7cf11dc1cd in Status: UNINITIALIZED for 2s [ 960.973258] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.973537] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.973674] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.973958] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.974192] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.974384] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port cb7912d5-59fd-44f6-8175-cbc4d736aa75 not found, creating... [ 960.974687] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.974846] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.974968] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.975214] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.976195] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.976877] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.976877] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.976877] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.977054] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.977182] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.977330] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: cb7912d5-59fd-44f6-8175-cbc4d736aa75 is going to be created. [ 960.981163] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f54639a3-c11e-4833-b47a-e0b477c46dd5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.002036] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.002036] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.002036] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.002036] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.002291] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.002495] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-cb7912d5-59fd-44f6-8175-cbc4d736aa75" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.432718] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f78f149-d978-4089-8aa8-d480e7d7bb61 in Status: SUCCESS [ 961.432996] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f78f149-d978-4089-8aa8-d480e7d7bb61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.483577] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.483757] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.483838] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.484083] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.484208] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.484313] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 is going to be updated. [ 961.521210] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.521362] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.521440] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.521810] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.522030] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.536704] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 in Status: IN_PROGRESS for 2s [ 961.816618] env[70392]: INFO networking_nsxv3.common.synchronization [req-b50fb22d-8996-45b3-b13d-f2c802f96d08 req-c5c829be-0176-4657-a0e3-f3cd19e208cc service nova] Enqueued Resource ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 with Priority: HIGHEST for action security_group_rules [ 961.816699] env[70392]: INFO networking_nsxv3.common.synchronization [req-b50fb22d-8996-45b3-b13d-f2c802f96d08 req-c5c829be-0176-4657-a0e3-f3cd19e208cc service nova] Enqueued Resource ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 with Priority: HIGHEST for action security_group_members [ 961.816834] env[70392]: INFO networking_nsxv3.common.synchronization [req-b50fb22d-8996-45b3-b13d-f2c802f96d08 req-c5c829be-0176-4657-a0e3-f3cd19e208cc service nova] Enqueued Resource ID: cb7912d5-59fd-44f6-8175-cbc4d736aa75 with Priority: HIGHEST for action port [ 961.817199] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 with Priority: HIGHEST for action security_group_rules [ 961.817396] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 with Priority: HIGHEST for action security_group_members [ 961.817595] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb7912d5-59fd-44f6-8175-cbc4d736aa75 with Priority: HIGHEST for action port [ 961.818798] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f54639a3-c11e-4833-b47a-e0b477c46dd5 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.818969] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.819150] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.819373] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.819465] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f54639a3-c11e-4833-b47a-e0b477c46dd5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.820481] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-f54639a3-c11e-4833-b47a-e0b477c46dd5 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.820657] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.820931] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-cb7912d5-59fd-44f6-8175-cbc4d736aa75 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.821065] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cb7912d5-59fd-44f6-8175-cbc4d736aa75" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.821136] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cb7912d5-59fd-44f6-8175-cbc4d736aa75" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.821330] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cb7912d5-59fd-44f6-8175-cbc4d736aa75" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.821412] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb7912d5-59fd-44f6-8175-cbc4d736aa75',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.325710] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-f54639a3-c11e-4833-b47a-e0b477c46dd5 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.325710] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.325710] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cb7912d5-59fd-44f6-8175-cbc4d736aa75 with status ACTIVE [ 962.325710] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.325710] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.325710] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.326127] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.326127] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.327597] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.327597] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.327597] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.327597] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.327597] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.327597] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.327597] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.327597] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.327597] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.327597] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.327597] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cb7912d5-59fd-44f6-8175-cbc4d736aa75 is going to be updated. [ 962.353843] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.354200] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.354200] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.354424] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.354631] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.354813] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cb7912d5-59fd-44f6-8175-cbc4d736aa75" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.816226] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40ebe9d4-d512-4967-99a6-0a7cf11dc1cd in Status: SUCCESS [ 962.816483] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40ebe9d4-d512-4967-99a6-0a7cf11dc1cd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.816685] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40ebe9d4-d512-4967-99a6-0a7cf11dc1cd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.816904] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40ebe9d4-d512-4967-99a6-0a7cf11dc1cd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.817114] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.817234] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.817319] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.817488] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.817750] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.820939] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40ebe9d4-d512-4967-99a6-0a7cf11dc1cd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.820939] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('40ebe9d4-d512-4967-99a6-0a7cf11dc1cd',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.322044] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('40ebe9d4-d512-4967-99a6-0a7cf11dc1cd',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.551027] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 in Status: SUCCESS [ 963.551707] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.551707] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.552522] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.552522] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.552522] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.552522] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.552522] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.552690] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.552690] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f54639a3-c11e-4833-b47a-e0b477c46dd5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.827347] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 40ebe9d4-d512-4967-99a6-0a7cf11dc1cd: rpc.has_security_group_logging(os_id): False [ 963.846276] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.846520] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.846626] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.847075] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.847155] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.847487] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.847666] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.847900] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.848020] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.848308] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.848458] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40ebe9d4-d512-4967-99a6-0a7cf11dc1cd is going to be created. [ 963.919121] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.921360] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.921360] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.921360] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.921360] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.944925] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40ebe9d4-d512-4967-99a6-0a7cf11dc1cd in Status: IN_PROGRESS for 2s [ 964.059360] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f54639a3-c11e-4833-b47a-e0b477c46dd5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.561602] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f54639a3-c11e-4833-b47a-e0b477c46dd5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.064115] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.064847] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.064964] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.065210] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.065307] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.065410] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 is going to be updated. [ 965.101042] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.101198] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.101271] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.101483] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.101720] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.112369] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 in Status: IN_PROGRESS for 2s [ 965.957929] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40ebe9d4-d512-4967-99a6-0a7cf11dc1cd in Status: SUCCESS [ 965.957929] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40ebe9d4-d512-4967-99a6-0a7cf11dc1cd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.821511] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 966.821511] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 966.924798] env[70392]: INFO networking_nsxv3.common.synchronization [None req-eef3fee2-b1b9-41a8-a191-5f89df105ffa tempest-ServerDiskConfigTestJSON-277542510 tempest-ServerDiskConfigTestJSON-277542510-project-member] Enqueued Resource ID: 5f4ec92b-98e0-43be-a058-52ad365073ff with Priority: HIGHEST for action security_group_rules [ 966.924798] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f4ec92b-98e0-43be-a058-52ad365073ff with Priority: HIGHEST for action security_group_rules [ 966.924798] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5f4ec92b-98e0-43be-a058-52ad365073ff taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.927202] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5f4ec92b-98e0-43be-a058-52ad365073ff" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.927349] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5f4ec92b-98e0-43be-a058-52ad365073ff" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.927688] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5f4ec92b-98e0-43be-a058-52ad365073ff" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.927762] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5f4ec92b-98e0-43be-a058-52ad365073ff',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.073253] env[70392]: INFO networking_nsxv3.common.synchronization [None req-b06a5d7a-8e3b-440f-8248-406f20bc2905 tempest-ServerDiskConfigTestJSON-277542510 tempest-ServerDiskConfigTestJSON-277542510-project-member] Enqueued Resource ID: 5f4ec92b-98e0-43be-a058-52ad365073ff with Priority: HIGHEST for action security_group_rules [ 967.075419] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f4ec92b-98e0-43be-a058-52ad365073ff with Priority: HIGHEST for action security_group_rules [ 967.075758] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5f4ec92b-98e0-43be-a058-52ad365073ff taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.075861] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5f4ec92b-98e0-43be-a058-52ad365073ff" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.124592] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 in Status: SUCCESS [ 967.124592] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.124592] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.124592] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.124592] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.124592] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.124592] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.124592] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.124592] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.124592] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.124592] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f54639a3-c11e-4833-b47a-e0b477c46dd5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.449343] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.449634] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.449634] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.449879] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.449974] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.450094] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5f4ec92b-98e0-43be-a058-52ad365073ff already deleted. [ 967.450182] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5f4ec92b-98e0-43be-a058-52ad365073ff" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.450748] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5f4ec92b-98e0-43be-a058-52ad365073ff" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.450920] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5f4ec92b-98e0-43be-a058-52ad365073ff" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.451010] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5f4ec92b-98e0-43be-a058-52ad365073ff',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.635510] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-f54639a3-c11e-4833-b47a-e0b477c46dd5 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.635672] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.635747] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.635975] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.636162] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.636268] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.636334] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.636487] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.636576] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.636664] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.636812] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-f54639a3-c11e-4833-b47a-e0b477c46dd5 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.636906] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.636966] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.637126] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.637264] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.637356] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.637416] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.637554] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.637629] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.637730] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.637826] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f54639a3-c11e-4833-b47a-e0b477c46dd5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.972335] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.972552] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.972609] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.972798] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.972891] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.972987] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5f4ec92b-98e0-43be-a058-52ad365073ff already deleted. [ 967.973088] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5f4ec92b-98e0-43be-a058-52ad365073ff" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.140443] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f54639a3-c11e-4833-b47a-e0b477c46dd5: rpc.has_security_group_logging(os_id): False [ 968.160518] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.162333] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.162333] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.162333] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.162333] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.162333] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.162333] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.162333] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.162333] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.162333] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.162333] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.162333] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.162333] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.162333] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.162333] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.162899] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.162899] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.162899] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.162899] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.162899] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.163130] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 is going to be updated. [ 968.238860] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.239028] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.239083] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.239287] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.239439] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.266629] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 in Status: IN_PROGRESS for 2s [ 970.290057] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 in Status: SUCCESS [ 970.290057] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.743569] env[70392]: INFO networking_nsxv3.common.synchronization [req-b367f6f9-68b8-43f5-a9fd-b4a3c6b763a4 req-7032cb72-2f57-4e09-a551-14e28cbcd203 tempest-ServerDiskConfigTestJSON-277542510 tempest-ServerDiskConfigTestJSON-277542510-project-member] Enqueued Resource ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 with Priority: HIGHEST for action security_group_members [ 970.744403] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 with Priority: HIGHEST for action security_group_members [ 970.744652] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60d7eaa-9583-4c75-97fa-4049c63576b6 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.744803] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.744890] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.746068] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.746269] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.746594] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.746594] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.746741] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.746741] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.746856] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b60d7eaa-9583-4c75-97fa-4049c63576b6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.255023] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.255023] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.255023] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.255023] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.255023] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.255023] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.255023] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.255023] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.255023] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.255023] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.255509] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 is going to be updated. [ 971.292357] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.292831] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.292831] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.292831] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.292970] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.302718] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 in Status: IN_PROGRESS for 2s [ 972.306522] env[70392]: INFO networking_nsxv3.common.synchronization [req-adcaa099-9034-43b1-978a-76f74aa1bfad req-a8c1ae7b-a36f-4ff1-ab5f-cdda48be3513 tempest-SecurityGroupsTestJSON-87195518 tempest-SecurityGroupsTestJSON-87195518-project-member] Enqueued Resource ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b with Priority: HIGHEST for action security_group_members [ 972.307131] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b with Priority: HIGHEST for action security_group_members [ 972.307459] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.307640] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.307674] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.307910] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.310277] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.311013] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.311133] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.311446] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.311679] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.312720] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.742240] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-459 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.742240] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-459" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.742240] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-459" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.742507] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-459" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.744629] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.744629] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.744629] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.744629] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.744629] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.744629] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 972.744629] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 972.744629] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 972.744629] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 972.744629] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 972.744629] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 972.745303] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 972.768409] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 972.769018] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 972.769231] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 972.769438] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-459" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.770089] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-5e2a66f2-6655-4eba-89ef-2b0a56a0007a taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.770318] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-5e2a66f2-6655-4eba-89ef-2b0a56a0007a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.770523] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-5e2a66f2-6655-4eba-89ef-2b0a56a0007a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.770793] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-5e2a66f2-6655-4eba-89ef-2b0a56a0007a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.770962] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e2a66f2-6655-4eba-89ef-2b0a56a0007a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.816394] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.273932] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.274200] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.274339] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.274692] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.274908] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.275170] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 5e2a66f2-6655-4eba-89ef-2b0a56a0007a not found, creating... [ 973.275674] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.275858] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.276117] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.276362] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.276517] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.276838] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.277029] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.277160] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.277405] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.277659] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.277729] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 5e2a66f2-6655-4eba-89ef-2b0a56a0007a is going to be created. [ 973.305408] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.305408] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.305408] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.305566] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.305788] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.306250] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-5e2a66f2-6655-4eba-89ef-2b0a56a0007a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.319453] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.321192] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 in Status: SUCCESS [ 973.321596] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 deletion is rescheduled due to dependency. [ 973.321770] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.823872] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.824448] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.825140] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.825418] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.825516] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.825981] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b is going to be updated. [ 973.948984] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.949226] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.949355] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.949542] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.949692] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.970027] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b in Status: IN_PROGRESS for 2s [ 974.218042] env[70392]: INFO networking_nsxv3.common.synchronization [req-adcaa099-9034-43b1-978a-76f74aa1bfad req-bbd7fcc0-bd85-4d04-a647-6c0bbe3ce9a2 service nova] Enqueued Resource ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b with Priority: HIGHEST for action security_group_rules [ 974.219087] env[70392]: INFO networking_nsxv3.common.synchronization [req-adcaa099-9034-43b1-978a-76f74aa1bfad req-bbd7fcc0-bd85-4d04-a647-6c0bbe3ce9a2 service nova] Enqueued Resource ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b with Priority: HIGHEST for action security_group_members [ 974.219087] env[70392]: INFO networking_nsxv3.common.synchronization [req-adcaa099-9034-43b1-978a-76f74aa1bfad req-bbd7fcc0-bd85-4d04-a647-6c0bbe3ce9a2 service nova] Enqueued Resource ID: 5e2a66f2-6655-4eba-89ef-2b0a56a0007a with Priority: HIGHEST for action port [ 974.219538] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b with Priority: HIGHEST for action security_group_rules [ 974.219723] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b with Priority: HIGHEST for action security_group_members [ 974.219899] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e2a66f2-6655-4eba-89ef-2b0a56a0007a with Priority: HIGHEST for action port [ 974.220278] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.220425] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.220558] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.220803] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.220912] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.222762] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.222880] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.223545] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-5e2a66f2-6655-4eba-89ef-2b0a56a0007a taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.223545] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5e2a66f2-6655-4eba-89ef-2b0a56a0007a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.223545] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5e2a66f2-6655-4eba-89ef-2b0a56a0007a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.223545] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5e2a66f2-6655-4eba-89ef-2b0a56a0007a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.224720] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e2a66f2-6655-4eba-89ef-2b0a56a0007a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.725774] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.726155] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.728289] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5e2a66f2-6655-4eba-89ef-2b0a56a0007a with status ACTIVE [ 974.728559] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.728676] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.728676] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.728938] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.729085] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.729269] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.729369] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.729432] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.729847] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.729847] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.729847] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.730037] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.730037] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.730115] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.730204] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.730292] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5e2a66f2-6655-4eba-89ef-2b0a56a0007a is going to be updated. [ 974.756115] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.756272] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.756345] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.756554] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.756695] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.756856] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5e2a66f2-6655-4eba-89ef-2b0a56a0007a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.981682] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b in Status: SUCCESS [ 975.982128] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.982441] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.982869] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.983213] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.983456] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.983755] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.984394] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.984394] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.984394] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.487825] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.993456] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.496675] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.496768] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.496845] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.497071] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.497169] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.497290] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b is going to be updated. [ 977.536883] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.537043] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.537140] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.537374] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.537556] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.555532] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b in Status: IN_PROGRESS for 2s [ 977.659997] env[70392]: INFO networking_nsxv3.common.synchronization [None req-7fb24ef6-abfe-4e81-9d8f-cd4bcdb3247b tempest-AttachVolumeTestJSON-1272662447 tempest-AttachVolumeTestJSON-1272662447-project-member] Enqueued Resource ID: 2dfa1026-01a5-4176-a643-8ab1ceda5ce6 with Priority: HIGHEST for action security_group_rules [ 977.660651] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2dfa1026-01a5-4176-a643-8ab1ceda5ce6 with Priority: HIGHEST for action security_group_rules [ 977.660954] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2dfa1026-01a5-4176-a643-8ab1ceda5ce6 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.661161] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2dfa1026-01a5-4176-a643-8ab1ceda5ce6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.661258] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2dfa1026-01a5-4176-a643-8ab1ceda5ce6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.661513] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2dfa1026-01a5-4176-a643-8ab1ceda5ce6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.661633] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2dfa1026-01a5-4176-a643-8ab1ceda5ce6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.817254] env[70392]: INFO networking_nsxv3.common.synchronization [None req-60587454-f9f7-44d4-90cd-2299f46e280b tempest-AttachVolumeTestJSON-1272662447 tempest-AttachVolumeTestJSON-1272662447-project-member] Enqueued Resource ID: 2dfa1026-01a5-4176-a643-8ab1ceda5ce6 with Priority: HIGHEST for action security_group_rules [ 977.817813] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2dfa1026-01a5-4176-a643-8ab1ceda5ce6 with Priority: HIGHEST for action security_group_rules [ 977.818157] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2dfa1026-01a5-4176-a643-8ab1ceda5ce6 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.818267] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2dfa1026-01a5-4176-a643-8ab1ceda5ce6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.185395] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.185702] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.185702] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.186342] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.186925] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.187289] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2dfa1026-01a5-4176-a643-8ab1ceda5ce6 already deleted. [ 978.187705] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2dfa1026-01a5-4176-a643-8ab1ceda5ce6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.188525] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2dfa1026-01a5-4176-a643-8ab1ceda5ce6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.189767] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2dfa1026-01a5-4176-a643-8ab1ceda5ce6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.189969] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2dfa1026-01a5-4176-a643-8ab1ceda5ce6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.715018] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.715174] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.715246] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.715466] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.715581] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.715678] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2dfa1026-01a5-4176-a643-8ab1ceda5ce6 already deleted. [ 978.715764] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2dfa1026-01a5-4176-a643-8ab1ceda5ce6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.565565] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b in Status: SUCCESS [ 979.566209] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.566209] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.566350] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.566422] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.566538] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.566598] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.566750] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.566867] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.567015] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.567127] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.729177] env[70392]: INFO networking_nsxv3.common.synchronization [req-babcf428-f8a0-4a07-ba5c-de4ed698a501 req-aedc02ad-61d0-4442-8f55-1fd8f5e07eff tempest-MultipleCreateTestJSON-1646981689 tempest-MultipleCreateTestJSON-1646981689-project-member] Enqueued Resource ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 with Priority: HIGHEST for action security_group_members [ 979.731528] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 with Priority: HIGHEST for action security_group_members [ 979.732537] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-20f5b49b-d835-491d-a710-e2565f4af8b5 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.732537] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.732537] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.732704] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.732883] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.735894] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.735894] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.735894] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.735894] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.735894] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20f5b49b-d835-491d-a710-e2565f4af8b5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.791146] env[70392]: INFO networking_nsxv3.common.synchronization [req-27ccd1c7-0428-4352-8eae-9fa7a4f4f85d req-02badf83-100e-46a1-9f51-848716d2b8a0 tempest-ServerActionsV293TestJSON-2036472382 tempest-ServerActionsV293TestJSON-2036472382-project-member] Enqueued Resource ID: 44698b7f-7125-46d0-837f-5d44d3ee1aea with Priority: HIGHEST for action security_group_members [ 979.791146] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44698b7f-7125-46d0-837f-5d44d3ee1aea with Priority: HIGHEST for action security_group_members [ 979.791801] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-44698b7f-7125-46d0-837f-5d44d3ee1aea taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.792247] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44698b7f-7125-46d0-837f-5d44d3ee1aea" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.792361] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44698b7f-7125-46d0-837f-5d44d3ee1aea" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.792598] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44698b7f-7125-46d0-837f-5d44d3ee1aea" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.792817] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.792922] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.792986] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.793187] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.793271] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.794726] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44698b7f-7125-46d0-837f-5d44d3ee1aea',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.071755] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.071755] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.071755] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.071755] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.071755] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.071755] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.071755] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.071755] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.071755] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.071755] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.071755] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.071755] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.071755] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.071755] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.071755] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.071755] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.072480] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.072480] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.072480] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.072480] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.072480] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.240741] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.240910] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.240998] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.241651] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.241651] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.241651] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.242235] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.242235] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.242235] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.242235] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.242235] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 is going to be updated. [ 980.280342] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.280342] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.280342] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.280342] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.280342] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.290205] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 in Status: IN_PROGRESS for 2s [ 980.298532] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.298715] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.298801] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.299044] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.315636] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-638 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.315996] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-638" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.316202] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-638" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.316569] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-638" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.319463] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.319463] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.319463] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.319463] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.319463] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.319463] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 980.319463] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 980.319463] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 980.319463] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 980.319463] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 980.319463] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 980.319463] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 980.326561] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.326897] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.327190] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.327190] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.327394] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.327483] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.327584] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44698b7f-7125-46d0-837f-5d44d3ee1aea is going to be updated. [ 980.341890] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 980.342139] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 980.342322] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 980.342818] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-638" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.346319] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-97fd1569-e5c8-485f-8c9d-0ef40f387c18 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.346319] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-97fd1569-e5c8-485f-8c9d-0ef40f387c18" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.346319] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-97fd1569-e5c8-485f-8c9d-0ef40f387c18" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.346319] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-97fd1569-e5c8-485f-8c9d-0ef40f387c18" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.346319] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97fd1569-e5c8-485f-8c9d-0ef40f387c18',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.361542] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.361542] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.361542] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.361542] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.361542] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.373167] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44698b7f-7125-46d0-837f-5d44d3ee1aea in Status: IN_PROGRESS for 2s [ 980.574971] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b: rpc.has_security_group_logging(os_id): False [ 980.601024] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.601024] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.601024] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.601024] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.601024] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.601024] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.601024] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.601024] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.601024] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.601024] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.601024] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.601024] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.601024] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.601024] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.601024] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.602025] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.602425] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.602765] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.603031] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.603224] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.603417] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b is going to be updated. [ 980.685971] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.685971] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.685971] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.685971] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.685971] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.710821] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b in Status: IN_PROGRESS for 2s [ 980.848379] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.849335] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.849335] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.849475] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.849603] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.849826] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 97fd1569-e5c8-485f-8c9d-0ef40f387c18 not found, creating... [ 980.850242] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.851473] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.851473] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.851473] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.851473] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.851659] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.851659] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.851779] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.851995] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.852150] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.852321] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 97fd1569-e5c8-485f-8c9d-0ef40f387c18 is going to be created. [ 980.874466] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.874466] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.874466] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.875081] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.875444] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.875592] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-97fd1569-e5c8-485f-8c9d-0ef40f387c18" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.974889] env[70392]: INFO networking_nsxv3.common.synchronization [req-babcf428-f8a0-4a07-ba5c-de4ed698a501 req-c38207cb-acb7-4ee4-8518-1f6ffbaad8f2 service nova] Enqueued Resource ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 with Priority: HIGHEST for action security_group_rules [ 981.975176] env[70392]: INFO networking_nsxv3.common.synchronization [req-babcf428-f8a0-4a07-ba5c-de4ed698a501 req-c38207cb-acb7-4ee4-8518-1f6ffbaad8f2 service nova] Enqueued Resource ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 with Priority: HIGHEST for action security_group_members [ 981.975294] env[70392]: INFO networking_nsxv3.common.synchronization [req-babcf428-f8a0-4a07-ba5c-de4ed698a501 req-c38207cb-acb7-4ee4-8518-1f6ffbaad8f2 service nova] Enqueued Resource ID: 97fd1569-e5c8-485f-8c9d-0ef40f387c18 with Priority: HIGHEST for action port [ 981.975905] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 with Priority: HIGHEST for action security_group_rules [ 981.976365] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 with Priority: HIGHEST for action security_group_members [ 981.976518] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97fd1569-e5c8-485f-8c9d-0ef40f387c18 with Priority: HIGHEST for action port [ 981.976823] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-20f5b49b-d835-491d-a710-e2565f4af8b5 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.976974] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.977022] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.977232] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.977314] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('20f5b49b-d835-491d-a710-e2565f4af8b5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.982819] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-20f5b49b-d835-491d-a710-e2565f4af8b5 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.982967] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.983240] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-97fd1569-e5c8-485f-8c9d-0ef40f387c18 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.983396] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-97fd1569-e5c8-485f-8c9d-0ef40f387c18" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.983437] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-97fd1569-e5c8-485f-8c9d-0ef40f387c18" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.983611] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-97fd1569-e5c8-485f-8c9d-0ef40f387c18" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.983718] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97fd1569-e5c8-485f-8c9d-0ef40f387c18',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.304516] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 in Status: SUCCESS [ 982.304765] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 deletion is rescheduled due to dependency. [ 982.305369] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.305673] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.306018] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.306241] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.306363] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.306426] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.306596] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.306677] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.306770] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20f5b49b-d835-491d-a710-e2565f4af8b5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.388281] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44698b7f-7125-46d0-837f-5d44d3ee1aea in Status: SUCCESS [ 982.388528] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44698b7f-7125-46d0-837f-5d44d3ee1aea deletion is rescheduled due to dependency. [ 982.388642] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44698b7f-7125-46d0-837f-5d44d3ee1aea" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.488853] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-20f5b49b-d835-491d-a710-e2565f4af8b5 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.488853] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.488853] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 97fd1569-e5c8-485f-8c9d-0ef40f387c18 with status ACTIVE [ 982.488853] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.488853] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.488853] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.488853] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.488853] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.488853] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.488853] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.489965] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.489965] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.489965] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.489965] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.489965] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.489965] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.489965] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.489965] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.489965] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 97fd1569-e5c8-485f-8c9d-0ef40f387c18 is going to be updated. [ 982.519154] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.519279] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.519355] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.519565] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.519708] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.519869] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-97fd1569-e5c8-485f-8c9d-0ef40f387c18" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.732014] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b in Status: SUCCESS [ 982.732246] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.810901] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('20f5b49b-d835-491d-a710-e2565f4af8b5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.119281] env[70392]: INFO networking_nsxv3.common.synchronization [req-dc77145c-7285-45e9-8647-49c81b275c5f req-77a35116-f94c-4a78-93b0-3310ed04191c tempest-SecurityGroupsTestJSON-87195518 tempest-SecurityGroupsTestJSON-87195518-project-member] Enqueued Resource ID: 2d7b5b77-fadf-41e0-8ec9-a51ed0af628a with Priority: HIGHEST for action security_group_members [ 983.119281] env[70392]: INFO networking_nsxv3.common.synchronization [req-dc77145c-7285-45e9-8647-49c81b275c5f req-77a35116-f94c-4a78-93b0-3310ed04191c tempest-SecurityGroupsTestJSON-87195518 tempest-SecurityGroupsTestJSON-87195518-project-member] Enqueued Resource ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b with Priority: HIGHEST for action security_group_members [ 983.119281] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d7b5b77-fadf-41e0-8ec9-a51ed0af628a with Priority: HIGHEST for action security_group_members [ 983.122135] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b with Priority: HIGHEST for action security_group_members [ 983.122585] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d7b5b77-fadf-41e0-8ec9-a51ed0af628a taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.122860] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d7b5b77-fadf-41e0-8ec9-a51ed0af628a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.122925] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d7b5b77-fadf-41e0-8ec9-a51ed0af628a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.123242] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d7b5b77-fadf-41e0-8ec9-a51ed0af628a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.123922] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.124110] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.124192] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.124439] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.125457] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.125457] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d7b5b77-fadf-41e0-8ec9-a51ed0af628a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.127038] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.127038] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.127038] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.127038] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.127038] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.127038] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.127038] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.127038] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.127038] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.127466] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.314445] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('20f5b49b-d835-491d-a710-e2565f4af8b5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.530723] env[70392]: INFO networking_nsxv3.common.synchronization [req-dc77145c-7285-45e9-8647-49c81b275c5f req-77a35116-f94c-4a78-93b0-3310ed04191c tempest-SecurityGroupsTestJSON-87195518 tempest-SecurityGroupsTestJSON-87195518-project-member] Enqueued Resource ID: 2d7b5b77-fadf-41e0-8ec9-a51ed0af628a with Priority: HIGHEST for action security_group_rules [ 983.530723] env[70392]: INFO networking_nsxv3.common.synchronization [req-dc77145c-7285-45e9-8647-49c81b275c5f req-77a35116-f94c-4a78-93b0-3310ed04191c tempest-SecurityGroupsTestJSON-87195518 tempest-SecurityGroupsTestJSON-87195518-project-member] Enqueued Resource ID: 2d7b5b77-fadf-41e0-8ec9-a51ed0af628a with Priority: HIGHEST for action security_group_members [ 983.530723] env[70392]: INFO networking_nsxv3.common.synchronization [req-dc77145c-7285-45e9-8647-49c81b275c5f req-77a35116-f94c-4a78-93b0-3310ed04191c tempest-SecurityGroupsTestJSON-87195518 tempest-SecurityGroupsTestJSON-87195518-project-member] Enqueued Resource ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b with Priority: HIGHEST for action security_group_rules [ 983.530723] env[70392]: INFO networking_nsxv3.common.synchronization [req-dc77145c-7285-45e9-8647-49c81b275c5f req-77a35116-f94c-4a78-93b0-3310ed04191c tempest-SecurityGroupsTestJSON-87195518 tempest-SecurityGroupsTestJSON-87195518-project-member] Enqueued Resource ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b with Priority: HIGHEST for action security_group_members [ 983.530723] env[70392]: INFO networking_nsxv3.common.synchronization [req-dc77145c-7285-45e9-8647-49c81b275c5f req-77a35116-f94c-4a78-93b0-3310ed04191c tempest-SecurityGroupsTestJSON-87195518 tempest-SecurityGroupsTestJSON-87195518-project-member] Enqueued Resource ID: 5e2a66f2-6655-4eba-89ef-2b0a56a0007a with Priority: HIGHEST for action port [ 983.532540] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d7b5b77-fadf-41e0-8ec9-a51ed0af628a with Priority: HIGHEST for action security_group_rules [ 983.532540] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b with Priority: HIGHEST for action security_group_rules [ 983.532540] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e2a66f2-6655-4eba-89ef-2b0a56a0007a with Priority: HIGHEST for action port [ 983.532540] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d7b5b77-fadf-41e0-8ec9-a51ed0af628a with Priority: HIGHEST for action security_group_members [ 983.532540] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b with Priority: HIGHEST for action security_group_members [ 983.533015] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2d7b5b77-fadf-41e0-8ec9-a51ed0af628a taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.533952] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2d7b5b77-fadf-41e0-8ec9-a51ed0af628a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.534154] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2d7b5b77-fadf-41e0-8ec9-a51ed0af628a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.537932] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2d7b5b77-fadf-41e0-8ec9-a51ed0af628a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.538040] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2d7b5b77-fadf-41e0-8ec9-a51ed0af628a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.538955] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.540052] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.540140] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.540337] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.540548] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.541379] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-5e2a66f2-6655-4eba-89ef-2b0a56a0007a taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.541859] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5e2a66f2-6655-4eba-89ef-2b0a56a0007a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.541941] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5e2a66f2-6655-4eba-89ef-2b0a56a0007a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.542143] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5e2a66f2-6655-4eba-89ef-2b0a56a0007a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.542226] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e2a66f2-6655-4eba-89ef-2b0a56a0007a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.544183] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d7b5b77-fadf-41e0-8ec9-a51ed0af628a taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.544296] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d7b5b77-fadf-41e0-8ec9-a51ed0af628a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.544503] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.544588] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.628721] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2d7b5b77-fadf-41e0-8ec9-a51ed0af628a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.629999] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.819422] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.819619] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.819696] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.819915] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.820016] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.820124] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 is going to be updated. [ 983.852572] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.852750] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.852750] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.852962] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.853121] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.863590] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 in Status: IN_PROGRESS for 2s [ 984.045883] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.047255] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.047255] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d7b5b77-fadf-41e0-8ec9-a51ed0af628a taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.047255] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d7b5b77-fadf-41e0-8ec9-a51ed0af628a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.048348] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5e2a66f2-6655-4eba-89ef-2b0a56a0007a with status ACTIVE [ 984.048766] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.048766] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.048876] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.049031] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.049145] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.049300] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.049406] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.049516] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.049625] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.049702] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.049892] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.050053] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.050086] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.050208] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.050284] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.050370] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5e2a66f2-6655-4eba-89ef-2b0a56a0007a is going to be updated. [ 984.074765] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.074920] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.074988] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.075289] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.075504] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.075724] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5e2a66f2-6655-4eba-89ef-2b0a56a0007a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.131273] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2d7b5b77-fadf-41e0-8ec9-a51ed0af628a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.132280] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.634109] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.634328] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.634427] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.634647] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.634737] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.634841] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d7b5b77-fadf-41e0-8ec9-a51ed0af628a is going to be created. [ 984.636308] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.636425] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.636511] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.636791] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.636982] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.636982] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b is going to be updated. [ 984.667740] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.667740] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.667740] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.667740] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.667740] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.674654] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.674996] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.674996] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.675168] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.675426] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.679239] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d7b5b77-fadf-41e0-8ec9-a51ed0af628a in Status: UNINITIALIZED for 2s [ 984.685706] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b in Status: IN_PROGRESS for 2s [ 984.739776] env[70392]: INFO networking_nsxv3.common.synchronization [req-ef3d5a76-41ec-44d5-a612-e2f0149efc3f req-35ae5c81-59aa-4bac-abee-a2fd7b2b5529 tempest-ImagesTestJSON-499820929 tempest-ImagesTestJSON-499820929-project-member] Enqueued Resource ID: bca01ddc-73d5-4856-bbff-aefad642492a with Priority: HIGHEST for action security_group_members [ 984.740379] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bca01ddc-73d5-4856-bbff-aefad642492a with Priority: HIGHEST for action security_group_members [ 984.740683] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-bca01ddc-73d5-4856-bbff-aefad642492a taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.740827] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.740892] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.742350] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.742522] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.742628] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.742689] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.742899] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.743131] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.743131] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bca01ddc-73d5-4856-bbff-aefad642492a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.245915] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.246346] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.246346] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.246514] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.246645] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.246908] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.247062] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.247134] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.247350] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.247418] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.247525] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bca01ddc-73d5-4856-bbff-aefad642492a is going to be updated. [ 985.297302] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.297562] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.297562] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.297812] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.297982] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.308667] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bca01ddc-73d5-4856-bbff-aefad642492a in Status: IN_PROGRESS for 2s [ 985.875842] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 in Status: SUCCESS [ 985.875842] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.875842] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.875842] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.875842] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.875842] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.875842] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.875842] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.875842] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.875842] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.875842] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('20f5b49b-d835-491d-a710-e2565f4af8b5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.378229] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-20f5b49b-d835-491d-a710-e2565f4af8b5 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.378508] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.378508] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.378681] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.378842] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.378944] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.379014] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.379175] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.379266] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.379380] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.379542] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-20f5b49b-d835-491d-a710-e2565f4af8b5 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.379635] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.379696] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.379842] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.379978] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.380090] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.380168] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.380322] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.380397] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.380476] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.380556] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('20f5b49b-d835-491d-a710-e2565f4af8b5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.689758] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d7b5b77-fadf-41e0-8ec9-a51ed0af628a in Status: SUCCESS [ 986.689758] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d7b5b77-fadf-41e0-8ec9-a51ed0af628a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.690938] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d7b5b77-fadf-41e0-8ec9-a51ed0af628a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.690938] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d7b5b77-fadf-41e0-8ec9-a51ed0af628a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.691364] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.691364] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.696167] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.696167] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.696167] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.696167] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d7b5b77-fadf-41e0-8ec9-a51ed0af628a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.702285] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b in Status: SUCCESS [ 986.702502] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.702662] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.704075] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.704075] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.704075] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.704075] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.704075] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.704075] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.704075] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.883722] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 20f5b49b-d835-491d-a710-e2565f4af8b5: rpc.has_security_group_logging(os_id): False [ 986.906369] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.906659] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.906659] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.906803] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.907201] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.907201] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.907201] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.907489] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.907489] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.907489] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.907665] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.907744] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.907805] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.908020] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.913034] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.913432] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.913595] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.913667] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.913896] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.913981] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.914131] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 is going to be updated. [ 987.003255] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.003255] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.003255] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.003431] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.003474] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.026665] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 in Status: IN_PROGRESS for 2s [ 987.203235] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2d7b5b77-fadf-41e0-8ec9-a51ed0af628a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.206746] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.322054] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bca01ddc-73d5-4856-bbff-aefad642492a in Status: SUCCESS [ 987.322054] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bca01ddc-73d5-4856-bbff-aefad642492a deletion is rescheduled due to dependency. [ 987.322054] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.708812] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2d7b5b77-fadf-41e0-8ec9-a51ed0af628a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.709834] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.214261] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.214693] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.214693] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.214819] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.214819] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.214912] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d7b5b77-fadf-41e0-8ec9-a51ed0af628a is going to be updated. [ 988.218376] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.218376] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.218376] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.218376] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.218376] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.218376] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b is going to be updated. [ 988.268963] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.269164] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.269226] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.269496] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.269591] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.281231] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d7b5b77-fadf-41e0-8ec9-a51ed0af628a in Status: IN_PROGRESS for 2s [ 988.288879] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.288879] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.288879] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.288879] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.288879] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.300400] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b in Status: IN_PROGRESS for 2s [ 989.046842] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 in Status: SUCCESS [ 989.047546] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.741390] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 989.741459] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=4 [ 990.296420] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d7b5b77-fadf-41e0-8ec9-a51ed0af628a in Status: SUCCESS [ 990.296420] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d7b5b77-fadf-41e0-8ec9-a51ed0af628a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.296420] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d7b5b77-fadf-41e0-8ec9-a51ed0af628a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.296420] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d7b5b77-fadf-41e0-8ec9-a51ed0af628a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.296872] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.296872] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.296872] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.297133] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.297133] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.297238] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d7b5b77-fadf-41e0-8ec9-a51ed0af628a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.297238] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2d7b5b77-fadf-41e0-8ec9-a51ed0af628a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.312289] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b in Status: SUCCESS [ 990.312289] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.312289] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.312289] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.312289] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.312289] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.312289] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.312289] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.312289] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.312289] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.312289] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.800273] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2d7b5b77-fadf-41e0-8ec9-a51ed0af628a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.817474] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.817587] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.817664] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.818040] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.818098] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.818178] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.818243] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.818387] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.818474] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.818563] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.818711] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.818801] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.818862] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.819016] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.819159] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.819268] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.819334] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.819474] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.819552] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.819635] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.819725] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.303050] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2d7b5b77-fadf-41e0-8ec9-a51ed0af628a: rpc.has_security_group_logging(os_id): False [ 991.323721] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.323921] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.323976] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.324208] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.324492] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.324595] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.324659] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.324689] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.324845] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.324923] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.325024] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2d7b5b77-fadf-41e0-8ec9-a51ed0af628a is going to be created. [ 991.330799] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b: rpc.has_security_group_logging(os_id): False [ 991.353604] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.353604] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.353604] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.353851] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.353851] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.355184] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.355184] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.355184] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.355462] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.355462] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.356562] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.356701] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.356781] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.357238] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.357238] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.357329] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.357377] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.357407] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.357622] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.358030] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.358575] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b is going to be updated. [ 991.407779] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.407944] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.408024] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.408288] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.408483] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.423167] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d7b5b77-fadf-41e0-8ec9-a51ed0af628a in Status: IN_PROGRESS for 2s [ 991.432530] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.433215] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.433334] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.433622] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.433816] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.473671] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b in Status: IN_PROGRESS for 2s [ 991.996591] env[70392]: INFO networking_nsxv3.common.synchronization [req-69d87883-e477-4a5f-ba49-cda159df6726 req-1a8ff638-4168-4f7c-ba2f-3f38d0485548 tempest-SecurityGroupsTestJSON-87195518 tempest-SecurityGroupsTestJSON-87195518-project-member] Enqueued Resource ID: 2d7b5b77-fadf-41e0-8ec9-a51ed0af628a with Priority: HIGHEST for action security_group_members [ 991.996877] env[70392]: INFO networking_nsxv3.common.synchronization [req-69d87883-e477-4a5f-ba49-cda159df6726 req-1a8ff638-4168-4f7c-ba2f-3f38d0485548 tempest-SecurityGroupsTestJSON-87195518 tempest-SecurityGroupsTestJSON-87195518-project-member] Enqueued Resource ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b with Priority: HIGHEST for action security_group_members [ 991.997119] env[70392]: INFO networking_nsxv3.common.synchronization [req-69d87883-e477-4a5f-ba49-cda159df6726 req-1a8ff638-4168-4f7c-ba2f-3f38d0485548 tempest-SecurityGroupsTestJSON-87195518 tempest-SecurityGroupsTestJSON-87195518-project-member] Enqueued Resource ID: 9f0d5a7d-4c5f-45b6-b4db-9eb90c764585 with Priority: HIGHEST for action security_group_members [ 991.997759] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d7b5b77-fadf-41e0-8ec9-a51ed0af628a with Priority: HIGHEST for action security_group_members [ 991.998124] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b with Priority: HIGHEST for action security_group_members [ 991.998885] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f0d5a7d-4c5f-45b6-b4db-9eb90c764585 with Priority: HIGHEST for action security_group_members [ 991.998885] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d7b5b77-fadf-41e0-8ec9-a51ed0af628a taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.998885] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d7b5b77-fadf-41e0-8ec9-a51ed0af628a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.999259] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d7b5b77-fadf-41e0-8ec9-a51ed0af628a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.999295] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d7b5b77-fadf-41e0-8ec9-a51ed0af628a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.999487] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.999633] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.999716] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.999946] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.000094] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.000285] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d7b5b77-fadf-41e0-8ec9-a51ed0af628a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.002052] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.002052] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.002052] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.002052] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.002330] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.002330] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.002435] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.002513] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.002595] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.002696] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.003626] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f0d5a7d-4c5f-45b6-b4db-9eb90c764585 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.003745] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f0d5a7d-4c5f-45b6-b4db-9eb90c764585" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.003796] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f0d5a7d-4c5f-45b6-b4db-9eb90c764585" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.004118] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f0d5a7d-4c5f-45b6-b4db-9eb90c764585" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.004385] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.004385] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.004549] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.004590] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.004672] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.004759] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f0d5a7d-4c5f-45b6-b4db-9eb90c764585',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.119209] env[70392]: INFO networking_nsxv3.common.synchronization [req-69d87883-e477-4a5f-ba49-cda159df6726 req-1a8ff638-4168-4f7c-ba2f-3f38d0485548 tempest-SecurityGroupsTestJSON-87195518 tempest-SecurityGroupsTestJSON-87195518-project-member] Enqueued Resource ID: 2d7b5b77-fadf-41e0-8ec9-a51ed0af628a with Priority: HIGHEST for action security_group_rules [ 992.119460] env[70392]: INFO networking_nsxv3.common.synchronization [req-69d87883-e477-4a5f-ba49-cda159df6726 req-1a8ff638-4168-4f7c-ba2f-3f38d0485548 tempest-SecurityGroupsTestJSON-87195518 tempest-SecurityGroupsTestJSON-87195518-project-member] Enqueued Resource ID: 2d7b5b77-fadf-41e0-8ec9-a51ed0af628a with Priority: HIGHEST for action security_group_members [ 992.119605] env[70392]: INFO networking_nsxv3.common.synchronization [req-69d87883-e477-4a5f-ba49-cda159df6726 req-1a8ff638-4168-4f7c-ba2f-3f38d0485548 tempest-SecurityGroupsTestJSON-87195518 tempest-SecurityGroupsTestJSON-87195518-project-member] Enqueued Resource ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b with Priority: HIGHEST for action security_group_rules [ 992.119738] env[70392]: INFO networking_nsxv3.common.synchronization [req-69d87883-e477-4a5f-ba49-cda159df6726 req-1a8ff638-4168-4f7c-ba2f-3f38d0485548 tempest-SecurityGroupsTestJSON-87195518 tempest-SecurityGroupsTestJSON-87195518-project-member] Enqueued Resource ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b with Priority: HIGHEST for action security_group_members [ 992.119869] env[70392]: INFO networking_nsxv3.common.synchronization [req-69d87883-e477-4a5f-ba49-cda159df6726 req-1a8ff638-4168-4f7c-ba2f-3f38d0485548 tempest-SecurityGroupsTestJSON-87195518 tempest-SecurityGroupsTestJSON-87195518-project-member] Enqueued Resource ID: 9f0d5a7d-4c5f-45b6-b4db-9eb90c764585 with Priority: HIGHEST for action security_group_rules [ 992.119994] env[70392]: INFO networking_nsxv3.common.synchronization [req-69d87883-e477-4a5f-ba49-cda159df6726 req-1a8ff638-4168-4f7c-ba2f-3f38d0485548 tempest-SecurityGroupsTestJSON-87195518 tempest-SecurityGroupsTestJSON-87195518-project-member] Enqueued Resource ID: 9f0d5a7d-4c5f-45b6-b4db-9eb90c764585 with Priority: HIGHEST for action security_group_members [ 992.120194] env[70392]: INFO networking_nsxv3.common.synchronization [req-69d87883-e477-4a5f-ba49-cda159df6726 req-1a8ff638-4168-4f7c-ba2f-3f38d0485548 tempest-SecurityGroupsTestJSON-87195518 tempest-SecurityGroupsTestJSON-87195518-project-member] Enqueued Resource ID: 5e2a66f2-6655-4eba-89ef-2b0a56a0007a with Priority: HIGHEST for action port [ 992.120848] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d7b5b77-fadf-41e0-8ec9-a51ed0af628a with Priority: HIGHEST for action security_group_rules [ 992.121101] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b with Priority: HIGHEST for action security_group_rules [ 992.121199] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f0d5a7d-4c5f-45b6-b4db-9eb90c764585 with Priority: HIGHEST for action security_group_members [ 992.121301] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e2a66f2-6655-4eba-89ef-2b0a56a0007a with Priority: HIGHEST for action port [ 992.121388] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f0d5a7d-4c5f-45b6-b4db-9eb90c764585 with Priority: HIGHEST for action security_group_rules [ 992.121476] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d7b5b77-fadf-41e0-8ec9-a51ed0af628a with Priority: HIGHEST for action security_group_members [ 992.121559] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b with Priority: HIGHEST for action security_group_members [ 992.121869] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2d7b5b77-fadf-41e0-8ec9-a51ed0af628a taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.121966] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2d7b5b77-fadf-41e0-8ec9-a51ed0af628a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.122177] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.122255] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.127131] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f0d5a7d-4c5f-45b6-b4db-9eb90c764585 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.127131] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f0d5a7d-4c5f-45b6-b4db-9eb90c764585" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.127131] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-5e2a66f2-6655-4eba-89ef-2b0a56a0007a taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.127131] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5e2a66f2-6655-4eba-89ef-2b0a56a0007a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.127131] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5e2a66f2-6655-4eba-89ef-2b0a56a0007a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.127131] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5e2a66f2-6655-4eba-89ef-2b0a56a0007a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.127131] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e2a66f2-6655-4eba-89ef-2b0a56a0007a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.130055] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f0d5a7d-4c5f-45b6-b4db-9eb90c764585 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.130572] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f0d5a7d-4c5f-45b6-b4db-9eb90c764585" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.130667] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f0d5a7d-4c5f-45b6-b4db-9eb90c764585" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.131029] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f0d5a7d-4c5f-45b6-b4db-9eb90c764585" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.131138] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f0d5a7d-4c5f-45b6-b4db-9eb90c764585',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.133552] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d7b5b77-fadf-41e0-8ec9-a51ed0af628a taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.133824] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d7b5b77-fadf-41e0-8ec9-a51ed0af628a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.133978] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.134142] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.160251] env[70392]: INFO networking_nsxv3.common.synchronization [req-babcf428-f8a0-4a07-ba5c-de4ed698a501 req-198836d1-4e97-43ac-88ac-73f6e6c4bc18 tempest-MultipleCreateTestJSON-1646981689 tempest-MultipleCreateTestJSON-1646981689-project-member] Enqueued Resource ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 with Priority: HIGHEST for action security_group_members [ 992.161191] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 with Priority: HIGHEST for action security_group_members [ 992.161980] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-20f5b49b-d835-491d-a710-e2565f4af8b5 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.161980] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.161980] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.161980] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.162207] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.162498] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.162498] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.162697] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.162807] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.162940] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20f5b49b-d835-491d-a710-e2565f4af8b5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.170667] env[70392]: INFO networking_nsxv3.common.synchronization [req-2932762d-5514-420f-a794-3ed45b599910 req-54908a44-3110-4e88-9f69-7c940846266b tempest-ServerRescueTestJSON-347177866 tempest-ServerRescueTestJSON-347177866-project-member] Enqueued Resource ID: 03a8a1fe-a465-4403-8e2c-2170f54b59a0 with Priority: HIGHEST for action security_group_members [ 992.171355] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03a8a1fe-a465-4403-8e2c-2170f54b59a0 with Priority: HIGHEST for action security_group_members [ 992.171642] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-03a8a1fe-a465-4403-8e2c-2170f54b59a0 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.171815] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03a8a1fe-a465-4403-8e2c-2170f54b59a0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.171815] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03a8a1fe-a465-4403-8e2c-2170f54b59a0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.172494] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03a8a1fe-a465-4403-8e2c-2170f54b59a0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.172494] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.172980] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.172980] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.172980] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.172980] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.173140] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('03a8a1fe-a465-4403-8e2c-2170f54b59a0',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.429347] env[70392]: INFO networking_nsxv3.common.synchronization [None req-d0ebbb07-9425-4d80-b215-ad4ed6e3ba73 None None] Enqueued Resource ID: c8167a7f-7ef1-401e-8378-b6419e69dbe2 with Priority: HIGHEST for action port [ 992.429874] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8167a7f-7ef1-401e-8378-b6419e69dbe2 with Priority: HIGHEST for action port [ 992.430556] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-c8167a7f-7ef1-401e-8378-b6419e69dbe2 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.432224] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c8167a7f-7ef1-401e-8378-b6419e69dbe2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.432224] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c8167a7f-7ef1-401e-8378-b6419e69dbe2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.432224] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c8167a7f-7ef1-401e-8378-b6419e69dbe2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.432224] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c8167a7f-7ef1-401e-8378-b6419e69dbe2',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.509401] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.510428] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2d7b5b77-fadf-41e0-8ec9-a51ed0af628a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.511141] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9f0d5a7d-4c5f-45b6-b4db-9eb90c764585',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.631074] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5e2a66f2-6655-4eba-89ef-2b0a56a0007a with status ACTIVE [ 992.635136] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.635136] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.635136] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.635136] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.635136] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.635136] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.635136] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.635136] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.635136] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.635136] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.635136] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.635136] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.635136] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.635136] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.635136] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.635136] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5e2a66f2-6655-4eba-89ef-2b0a56a0007a is going to be updated. [ 992.636153] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f0d5a7d-4c5f-45b6-b4db-9eb90c764585 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.636292] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f0d5a7d-4c5f-45b6-b4db-9eb90c764585" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.639761] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-638 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.640089] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-638" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.640238] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-638" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.640625] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-638" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.641179] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.641355] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.641479] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.641808] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.642049] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.642579] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 992.642734] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 992.642858] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 992.642997] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 992.643131] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 992.643282] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 992.643644] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 992.659079] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.659235] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.659307] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.659651] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.659651] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.659813] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5e2a66f2-6655-4eba-89ef-2b0a56a0007a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.667352] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 992.667352] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 992.667352] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 992.667352] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-638" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.667352] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-b045d2b0-c8cc-4c89-b3fc-51956e167dca taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.667352] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-b045d2b0-c8cc-4c89-b3fc-51956e167dca" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.667352] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-b045d2b0-c8cc-4c89-b3fc-51956e167dca" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.667352] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-b045d2b0-c8cc-4c89-b3fc-51956e167dca" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.667352] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b045d2b0-c8cc-4c89-b3fc-51956e167dca',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.668179] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('20f5b49b-d835-491d-a710-e2565f4af8b5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.679979] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.680184] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.680184] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.680443] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.680507] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.680719] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.680719] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.680841] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.680929] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.680997] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.681118] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03a8a1fe-a465-4403-8e2c-2170f54b59a0 is going to be updated. [ 992.711890] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.712127] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.712127] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.712249] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.712950] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.735154] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03a8a1fe-a465-4403-8e2c-2170f54b59a0 in Status: IN_PROGRESS for 2s [ 992.933328] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c8167a7f-7ef1-401e-8378-b6419e69dbe2 [ 992.933647] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.933789] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.933861] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.936340] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.936496] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.936626] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c8167a7f-7ef1-401e-8378-b6419e69dbe2 already deleted. [ 992.936729] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c8167a7f-7ef1-401e-8378-b6419e69dbe2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.013579] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9f0d5a7d-4c5f-45b6-b4db-9eb90c764585',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.014868] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.015385] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2d7b5b77-fadf-41e0-8ec9-a51ed0af628a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.170891] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.171234] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.171397] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.172844] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.173102] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.173591] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port b045d2b0-c8cc-4c89-b3fc-51956e167dca not found, creating... [ 993.173591] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.173745] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.173868] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.174568] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.174568] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.174662] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.174912] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.174912] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.175179] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.175318] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.175512] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: b045d2b0-c8cc-4c89-b3fc-51956e167dca is going to be created. [ 993.177172] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('20f5b49b-d835-491d-a710-e2565f4af8b5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.180062] env[70392]: INFO networking_nsxv3.common.synchronization [None req-bd2a93a1-4320-4f4d-be5b-3ebe2a94cc91 tempest-ServersTestManualDisk-1686983804 tempest-ServersTestManualDisk-1686983804-project-member] Enqueued Resource ID: 07383bb9-9bd2-43da-8cb5-da905d6129d5 with Priority: HIGHEST for action security_group_rules [ 993.181408] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07383bb9-9bd2-43da-8cb5-da905d6129d5 with Priority: HIGHEST for action security_group_rules [ 993.181699] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07383bb9-9bd2-43da-8cb5-da905d6129d5 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.181861] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07383bb9-9bd2-43da-8cb5-da905d6129d5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.181926] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07383bb9-9bd2-43da-8cb5-da905d6129d5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.183677] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07383bb9-9bd2-43da-8cb5-da905d6129d5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.183749] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07383bb9-9bd2-43da-8cb5-da905d6129d5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.219672] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.219989] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.220339] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.220683] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.221325] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.221558] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-b045d2b0-c8cc-4c89-b3fc-51956e167dca" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.399411] env[70392]: INFO networking_nsxv3.common.synchronization [None req-2193b9c8-1f3b-4632-af93-0c8954ed9785 tempest-ServersTestManualDisk-1686983804 tempest-ServersTestManualDisk-1686983804-project-member] Enqueued Resource ID: 07383bb9-9bd2-43da-8cb5-da905d6129d5 with Priority: HIGHEST for action security_group_rules [ 993.404145] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07383bb9-9bd2-43da-8cb5-da905d6129d5 with Priority: HIGHEST for action security_group_rules [ 993.404928] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07383bb9-9bd2-43da-8cb5-da905d6129d5 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.405070] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07383bb9-9bd2-43da-8cb5-da905d6129d5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.441229] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d7b5b77-fadf-41e0-8ec9-a51ed0af628a in Status: SUCCESS [ 993.441532] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2d7b5b77-fadf-41e0-8ec9-a51ed0af628a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.443314] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2d7b5b77-fadf-41e0-8ec9-a51ed0af628a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.443314] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2d7b5b77-fadf-41e0-8ec9-a51ed0af628a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.443314] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2d7b5b77-fadf-41e0-8ec9-a51ed0af628a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.487897] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b in Status: SUCCESS [ 993.487897] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.487897] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.488196] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.488734] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.517617] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.520666] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.520666] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.520666] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.520666] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.520666] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d7b5b77-fadf-41e0-8ec9-a51ed0af628a is going to be updated. [ 993.520666] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.520666] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.520666] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.520666] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.520666] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.520666] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b is going to be updated. [ 993.521671] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.521776] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.521843] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.521994] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.522117] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.522165] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f0d5a7d-4c5f-45b6-b4db-9eb90c764585 is going to be created. [ 993.555050] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.555332] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.555332] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.558033] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.558033] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.560503] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.560668] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.560842] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.560952] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.562062] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.565037] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.565037] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.565037] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.565037] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.565037] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.570445] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f0d5a7d-4c5f-45b6-b4db-9eb90c764585 in Status: UNINITIALIZED for 2s [ 993.572606] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b in Status: IN_PROGRESS for 2s [ 993.573215] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d7b5b77-fadf-41e0-8ec9-a51ed0af628a in Status: IN_PROGRESS for 2s [ 993.683252] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.683477] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.683477] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.683688] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.683776] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.683878] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 is going to be updated. [ 993.705892] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.706052] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.706052] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.706342] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.706460] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.706562] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07383bb9-9bd2-43da-8cb5-da905d6129d5 already deleted. [ 993.706646] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07383bb9-9bd2-43da-8cb5-da905d6129d5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.706802] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07383bb9-9bd2-43da-8cb5-da905d6129d5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.706966] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07383bb9-9bd2-43da-8cb5-da905d6129d5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.707124] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07383bb9-9bd2-43da-8cb5-da905d6129d5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.716613] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.718322] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.718322] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.718550] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.718705] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.729999] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 in Status: IN_PROGRESS for 2s [ 993.949069] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d7b5b77-fadf-41e0-8ec9-a51ed0af628a taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.949458] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d7b5b77-fadf-41e0-8ec9-a51ed0af628a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.999185] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.999185] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.009213] env[70392]: INFO networking_nsxv3.common.synchronization [req-babcf428-f8a0-4a07-ba5c-de4ed698a501 req-b8371726-bfae-458b-ab7f-5dce1d94a87f service nova] Enqueued Resource ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 with Priority: HIGHEST for action security_group_rules [ 994.009213] env[70392]: INFO networking_nsxv3.common.synchronization [req-babcf428-f8a0-4a07-ba5c-de4ed698a501 req-b8371726-bfae-458b-ab7f-5dce1d94a87f service nova] Enqueued Resource ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 with Priority: HIGHEST for action security_group_members [ 994.009213] env[70392]: INFO networking_nsxv3.common.synchronization [req-babcf428-f8a0-4a07-ba5c-de4ed698a501 req-b8371726-bfae-458b-ab7f-5dce1d94a87f service nova] Enqueued Resource ID: b045d2b0-c8cc-4c89-b3fc-51956e167dca with Priority: HIGHEST for action port [ 994.009213] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 with Priority: HIGHEST for action security_group_rules [ 994.009213] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 with Priority: HIGHEST for action security_group_members [ 994.009213] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b045d2b0-c8cc-4c89-b3fc-51956e167dca with Priority: HIGHEST for action port [ 994.009213] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-20f5b49b-d835-491d-a710-e2565f4af8b5 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.009213] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.009213] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.009213] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.009213] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('20f5b49b-d835-491d-a710-e2565f4af8b5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.010214] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-20f5b49b-d835-491d-a710-e2565f4af8b5 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.010311] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.010510] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-b045d2b0-c8cc-4c89-b3fc-51956e167dca taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.010611] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b045d2b0-c8cc-4c89-b3fc-51956e167dca" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.010676] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b045d2b0-c8cc-4c89-b3fc-51956e167dca" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.012244] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b045d2b0-c8cc-4c89-b3fc-51956e167dca" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.012244] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b045d2b0-c8cc-4c89-b3fc-51956e167dca',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.237280] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.237428] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.237495] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.237713] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.237811] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.237889] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07383bb9-9bd2-43da-8cb5-da905d6129d5 already deleted. [ 994.237968] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07383bb9-9bd2-43da-8cb5-da905d6129d5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.513591] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-20f5b49b-d835-491d-a710-e2565f4af8b5 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.513981] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.513981] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b045d2b0-c8cc-4c89-b3fc-51956e167dca with status ACTIVE [ 994.514164] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.514356] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.514415] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.514593] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.514681] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.514855] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.514953] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.515033] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.515199] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.515306] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.515494] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.515587] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.515647] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.515790] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.515863] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.515948] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b045d2b0-c8cc-4c89-b3fc-51956e167dca is going to be updated. [ 994.540627] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.540894] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.540894] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.541270] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.541459] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.541638] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b045d2b0-c8cc-4c89-b3fc-51956e167dca" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.750201] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03a8a1fe-a465-4403-8e2c-2170f54b59a0 in Status: SUCCESS [ 994.750494] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03a8a1fe-a465-4403-8e2c-2170f54b59a0 deletion is rescheduled due to dependency. [ 994.750628] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03a8a1fe-a465-4403-8e2c-2170f54b59a0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.144459] env[70392]: INFO networking_nsxv3.common.synchronization [None req-160593d4-6875-4060-9f2c-002630b921a4 None None] Enqueued Resource ID: bee47e81-5c6c-4f6e-8bdf-e7d32c44747d with Priority: HIGHEST for action port [ 995.144967] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bee47e81-5c6c-4f6e-8bdf-e7d32c44747d with Priority: HIGHEST for action port [ 995.145252] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-bee47e81-5c6c-4f6e-8bdf-e7d32c44747d taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.145376] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bee47e81-5c6c-4f6e-8bdf-e7d32c44747d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.145442] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bee47e81-5c6c-4f6e-8bdf-e7d32c44747d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.145723] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bee47e81-5c6c-4f6e-8bdf-e7d32c44747d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.145810] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bee47e81-5c6c-4f6e-8bdf-e7d32c44747d',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.534989] env[70392]: INFO networking_nsxv3.common.synchronization [req-a33fd960-75ef-4f34-bd81-534fd41099cd req-41e04c3a-1eaa-4a7e-a9cd-da7a39f87138 tempest-SecurityGroupsTestJSON-87195518 tempest-SecurityGroupsTestJSON-87195518-project-member] Enqueued Resource ID: 2d7b5b77-fadf-41e0-8ec9-a51ed0af628a with Priority: HIGHEST for action security_group_members [ 995.534989] env[70392]: INFO networking_nsxv3.common.synchronization [req-a33fd960-75ef-4f34-bd81-534fd41099cd req-41e04c3a-1eaa-4a7e-a9cd-da7a39f87138 tempest-SecurityGroupsTestJSON-87195518 tempest-SecurityGroupsTestJSON-87195518-project-member] Enqueued Resource ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b with Priority: HIGHEST for action security_group_members [ 995.534989] env[70392]: INFO networking_nsxv3.common.synchronization [req-a33fd960-75ef-4f34-bd81-534fd41099cd req-41e04c3a-1eaa-4a7e-a9cd-da7a39f87138 tempest-SecurityGroupsTestJSON-87195518 tempest-SecurityGroupsTestJSON-87195518-project-member] Enqueued Resource ID: 9f0d5a7d-4c5f-45b6-b4db-9eb90c764585 with Priority: HIGHEST for action security_group_members [ 995.535744] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d7b5b77-fadf-41e0-8ec9-a51ed0af628a with Priority: HIGHEST for action security_group_members [ 995.535744] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b with Priority: HIGHEST for action security_group_members [ 995.535744] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f0d5a7d-4c5f-45b6-b4db-9eb90c764585 with Priority: HIGHEST for action security_group_members [ 995.536162] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d7b5b77-fadf-41e0-8ec9-a51ed0af628a taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.536272] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d7b5b77-fadf-41e0-8ec9-a51ed0af628a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.536416] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.536498] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.537244] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f0d5a7d-4c5f-45b6-b4db-9eb90c764585 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.537389] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f0d5a7d-4c5f-45b6-b4db-9eb90c764585" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.552227] env[70392]: INFO networking_nsxv3.common.synchronization [req-f057fa84-7a1b-4a28-9d24-02c92d646137 req-13b56950-b780-4729-bd2b-dd8da1ad144a tempest-MigrationsAdminTest-1525374997 tempest-MigrationsAdminTest-1525374997-project-member] Enqueued Resource ID: 5fec7002-3137-40f1-a653-f520126396a2 with Priority: HIGHEST for action security_group_members [ 995.552495] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fec7002-3137-40f1-a653-f520126396a2 with Priority: HIGHEST for action security_group_members [ 995.553069] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fec7002-3137-40f1-a653-f520126396a2 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.553182] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.553269] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.553479] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.553636] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.553735] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.553796] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.553966] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.554527] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.554632] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5fec7002-3137-40f1-a653-f520126396a2',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.581720] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f0d5a7d-4c5f-45b6-b4db-9eb90c764585 in Status: SUCCESS [ 995.581956] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f0d5a7d-4c5f-45b6-b4db-9eb90c764585" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.582677] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b in Status: SUCCESS [ 995.582865] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.583111] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f0d5a7d-4c5f-45b6-b4db-9eb90c764585" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.583329] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f0d5a7d-4c5f-45b6-b4db-9eb90c764585" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.583538] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.583669] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.583765] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.583984] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.584133] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.584236] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f0d5a7d-4c5f-45b6-b4db-9eb90c764585',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.585796] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.585953] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.586139] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.586247] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.586313] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.587268] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.587363] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.587463] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.589107] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d7b5b77-fadf-41e0-8ec9-a51ed0af628a in Status: SUCCESS [ 995.589107] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d7b5b77-fadf-41e0-8ec9-a51ed0af628a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.589862] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d7b5b77-fadf-41e0-8ec9-a51ed0af628a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.590052] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d7b5b77-fadf-41e0-8ec9-a51ed0af628a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.590228] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.590328] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.590394] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.590538] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.590615] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.590701] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d7b5b77-fadf-41e0-8ec9-a51ed0af628a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.651320] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bee47e81-5c6c-4f6e-8bdf-e7d32c44747d [ 995.651439] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.651575] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.651641] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.651849] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.651934] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.652041] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bee47e81-5c6c-4f6e-8bdf-e7d32c44747d already deleted. [ 995.652122] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bee47e81-5c6c-4f6e-8bdf-e7d32c44747d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.739502] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 in Status: SUCCESS [ 995.739720] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.739879] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.740338] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.740571] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.740692] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.740759] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.741033] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.741194] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.741300] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20f5b49b-d835-491d-a710-e2565f4af8b5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.058332] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5fec7002-3137-40f1-a653-f520126396a2',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.095024] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.095024] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.095024] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.095024] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.095024] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.095024] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.095024] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.095024] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.095024] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.095024] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.095024] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f0d5a7d-4c5f-45b6-b4db-9eb90c764585 is going to be deleted. [ 996.095024] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.096624] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.096922] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.097160] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.097438] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.097636] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.097975] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.098238] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.098525] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.098781] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.098969] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.099179] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d7b5b77-fadf-41e0-8ec9-a51ed0af628a is going to be updated. [ 996.135460] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.136314] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.136419] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.136864] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.136864] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.136864] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f0d5a7d-4c5f-45b6-b4db-9eb90c764585" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.137334] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f0d5a7d-4c5f-45b6-b4db-9eb90c764585" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.137334] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f0d5a7d-4c5f-45b6-b4db-9eb90c764585" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.137433] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.137540] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.137605] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.137748] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.137826] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.137921] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f0d5a7d-4c5f-45b6-b4db-9eb90c764585',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.140242] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.140368] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.140440] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.140610] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.140744] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.154190] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d7b5b77-fadf-41e0-8ec9-a51ed0af628a in Status: IN_PROGRESS for 2s [ 996.245557] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('20f5b49b-d835-491d-a710-e2565f4af8b5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.563234] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5fec7002-3137-40f1-a653-f520126396a2',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.602016] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.640460] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.640709] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.640709] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.640944] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.641023] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.641262] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.641390] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.641485] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.641659] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.641740] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.641827] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f0d5a7d-4c5f-45b6-b4db-9eb90c764585 already deleted. [ 996.641907] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f0d5a7d-4c5f-45b6-b4db-9eb90c764585" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.642021] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9f0d5a7d-4c5f-45b6-b4db-9eb90c764585',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.642825] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f0d5a7d-4c5f-45b6-b4db-9eb90c764585" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.643037] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f0d5a7d-4c5f-45b6-b4db-9eb90c764585" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.643198] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.643317] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.643390] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.643581] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.643661] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.643746] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f0d5a7d-4c5f-45b6-b4db-9eb90c764585',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.746803] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('20f5b49b-d835-491d-a710-e2565f4af8b5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.065536] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.065859] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.065951] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.066211] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.066318] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.066588] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5fec7002-3137-40f1-a653-f520126396a2 is going to be updated. [ 997.099115] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.099115] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.099115] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.099504] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.099678] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.104601] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.104601] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.104794] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.105238] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.105238] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.105238] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b is going to be updated. [ 997.116105] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5fec7002-3137-40f1-a653-f520126396a2 in Status: IN_PROGRESS for 2s [ 997.139129] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.139305] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.139379] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.139581] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.139717] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.145664] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9f0d5a7d-4c5f-45b6-b4db-9eb90c764585',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.146590] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.146720] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.146790] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.146976] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.147076] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.147250] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.147342] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.147711] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.147711] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.147711] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.147711] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f0d5a7d-4c5f-45b6-b4db-9eb90c764585 already deleted. [ 997.147886] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f0d5a7d-4c5f-45b6-b4db-9eb90c764585" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.149857] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b in Status: IN_PROGRESS for 2s [ 997.250222] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.250222] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.250222] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.250222] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.250222] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.250424] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 is going to be updated. [ 997.294059] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.294307] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.294393] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.294699] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.294879] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.306089] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 in Status: IN_PROGRESS for 2s [ 997.649057] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9f0d5a7d-4c5f-45b6-b4db-9eb90c764585: rpc.has_security_group_logging(os_id): False [ 997.666200] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.666421] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.666421] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.666701] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.666701] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.666896] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.666988] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.667062] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.667209] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.667288] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.667365] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f0d5a7d-4c5f-45b6-b4db-9eb90c764585 is going to be created. [ 997.684339] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/9f0d5a7d-4c5f-45b6-b4db-9eb90c764585], does not exist path=[/infra/domains/default/groups/9f0d5a7d-4c5f-45b6-b4db-9eb90c764585]."\n}' [ 997.684742] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f0d5a7d-4c5f-45b6-b4db-9eb90c764585 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/9f0d5a7d-4c5f-45b6-b4db-9eb90c764585 [ 997.684868] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 997.737897] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.737897] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.737897] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.737897] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.738995] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.739307] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.739410] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.739475] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.739647] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.739728] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.739931] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.740063] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.740165] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.740366] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.740448] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.740539] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f0d5a7d-4c5f-45b6-b4db-9eb90c764585 is going to be created. [ 997.763121] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/9f0d5a7d-4c5f-45b6-b4db-9eb90c764585], does not exist path=[/infra/domains/default/groups/9f0d5a7d-4c5f-45b6-b4db-9eb90c764585]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/9f0d5a7d-4c5f-45b6-b4db-9eb90c764585 [ 997.763299] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f0d5a7d-4c5f-45b6-b4db-9eb90c764585" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.763602] env[70392]: Traceback (most recent call last): [ 997.763661] env[70392]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 997.763661] env[70392]: return func(*args, **kwargs) [ 997.763661] env[70392]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 997.763661] env[70392]: res.raise_for_status() [ 997.763661] env[70392]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 997.763661] env[70392]: raise HTTPError(http_error_msg, response=self) [ 997.763661] env[70392]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/9f0d5a7d-4c5f-45b6-b4db-9eb90c764585 [ 997.763661] env[70392]: During handling of the above exception, another exception occurred: [ 997.763661] env[70392]: Traceback (most recent call last): [ 997.763941] env[70392]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 997.763941] env[70392]: listener.cb(fileno) [ 997.763941] env[70392]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 997.763941] env[70392]: result = function(*args, **kwargs) [ 997.763941] env[70392]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 997.763941] env[70392]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 997.763941] env[70392]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 997.763941] env[70392]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 997.763941] env[70392]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 997.763941] env[70392]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 997.763941] env[70392]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 997.763941] env[70392]: res.raise_for_status() [ 997.763941] env[70392]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 997.763941] env[70392]: raise HTTPError(http_error_msg, response=self) [ 997.763941] env[70392]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/9f0d5a7d-4c5f-45b6-b4db-9eb90c764585 [ 997.763941] env[70392]: Removing descriptor: 27 [ 998.167186] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d7b5b77-fadf-41e0-8ec9-a51ed0af628a in Status: SUCCESS [ 998.167312] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d7b5b77-fadf-41e0-8ec9-a51ed0af628a deletion is rescheduled due to dependency. [ 998.167369] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d7b5b77-fadf-41e0-8ec9-a51ed0af628a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.167539] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d7b5b77-fadf-41e0-8ec9-a51ed0af628a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.167770] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d7b5b77-fadf-41e0-8ec9-a51ed0af628a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.167992] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.168152] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.168257] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.168384] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.168469] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.168536] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d7b5b77-fadf-41e0-8ec9-a51ed0af628a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.168642] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2d7b5b77-fadf-41e0-8ec9-a51ed0af628a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.169547] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d7b5b77-fadf-41e0-8ec9-a51ed0af628a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.169733] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d7b5b77-fadf-41e0-8ec9-a51ed0af628a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.170062] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.170062] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.170245] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.170453] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.170453] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.170453] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d7b5b77-fadf-41e0-8ec9-a51ed0af628a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.673038] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2d7b5b77-fadf-41e0-8ec9-a51ed0af628a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.674582] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.674771] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.674839] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.675156] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.699801] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.700085] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.700221] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.700305] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.700535] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.700632] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.700727] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d7b5b77-fadf-41e0-8ec9-a51ed0af628a is going to be updated. [ 998.740402] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.740648] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.740648] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.741168] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.741168] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.753025] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d7b5b77-fadf-41e0-8ec9-a51ed0af628a in Status: IN_PROGRESS for 2s [ 999.130227] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5fec7002-3137-40f1-a653-f520126396a2 in Status: SUCCESS [ 999.130227] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.164374] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b in Status: SUCCESS [ 999.164720] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.164958] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.165198] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.165640] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.165640] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.165640] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.165865] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.165865] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.165965] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.166015] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.167527] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.167754] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.167956] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.168115] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.168670] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.168670] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.168670] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.168670] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.177570] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2d7b5b77-fadf-41e0-8ec9-a51ed0af628a: rpc.has_security_group_logging(os_id): False [ 999.200638] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.201103] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.201103] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.201211] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.201344] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.201561] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.201676] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.201738] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.201923] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.201982] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.202099] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2d7b5b77-fadf-41e0-8ec9-a51ed0af628a is going to be updated. [ 999.294888] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.294888] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.294888] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.294888] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.294888] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.307382] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d7b5b77-fadf-41e0-8ec9-a51ed0af628a in Status: IN_PROGRESS for 2s [ 999.316676] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 in Status: SUCCESS [ 999.317242] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.317539] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.318048] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.319761] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.319761] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.319761] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.319761] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.319761] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.319761] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.319761] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('20f5b49b-d835-491d-a710-e2565f4af8b5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.672173] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.673094] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.673833] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.821888] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-20f5b49b-d835-491d-a710-e2565f4af8b5 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.822557] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.823612] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.824038] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.824282] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.824492] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.824623] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.824835] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.825862] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.826021] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.826369] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-20f5b49b-d835-491d-a710-e2565f4af8b5 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.827274] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.827375] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.827577] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.828242] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.828391] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.828485] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.828672] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.828790] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.828906] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.829036] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('20f5b49b-d835-491d-a710-e2565f4af8b5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.121261] env[70392]: INFO networking_nsxv3.common.synchronization [req-a4d20392-2a37-4c33-9d7e-e6c312351bf1 req-4bdc9c81-5f62-4d8d-bc55-d13eac630543 tempest-DeleteServersTestJSON-1676313022 tempest-DeleteServersTestJSON-1676313022-project-member] Enqueued Resource ID: ce79170a-31ce-429e-8e08-a911557872f4 with Priority: HIGHEST for action security_group_members [ 1000.121900] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce79170a-31ce-429e-8e08-a911557872f4 with Priority: HIGHEST for action security_group_members [ 1000.122275] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce79170a-31ce-429e-8e08-a911557872f4 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.122459] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.122545] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.122794] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.122976] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.123201] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.123305] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.123501] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.123648] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.124088] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce79170a-31ce-429e-8e08-a911557872f4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.178498] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.332623] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 20f5b49b-d835-491d-a710-e2565f4af8b5: rpc.has_security_group_logging(os_id): False [ 1000.353440] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.356311] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.356311] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.356311] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.378918] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.378918] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.378918] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.378918] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.378918] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.378918] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.378918] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.378918] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.378918] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.378918] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.378918] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.378918] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.378918] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.378918] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.379434] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.379434] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.379434] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 is going to be updated. [ 1000.448901] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.448901] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.448901] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.448901] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.448901] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.461221] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 in Status: IN_PROGRESS for 2s [ 1000.629653] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.629789] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.629911] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.630492] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.662750] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.662750] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.662750] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.662750] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.662750] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.662750] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.662750] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce79170a-31ce-429e-8e08-a911557872f4 is going to be updated. [ 1000.681426] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.682210] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.682210] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.682210] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.682210] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.682210] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b is going to be updated. [ 1000.689719] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.689860] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.689901] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.690153] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.690299] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.699297] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce79170a-31ce-429e-8e08-a911557872f4 in Status: IN_PROGRESS for 2s [ 1000.729134] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.730053] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.730053] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.730053] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.730191] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.744311] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b in Status: IN_PROGRESS for 2s [ 1000.762960] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d7b5b77-fadf-41e0-8ec9-a51ed0af628a in Status: SUCCESS [ 1000.763199] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d7b5b77-fadf-41e0-8ec9-a51ed0af628a deletion is rescheduled due to dependency. [ 1000.763199] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d7b5b77-fadf-41e0-8ec9-a51ed0af628a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.332944] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d7b5b77-fadf-41e0-8ec9-a51ed0af628a in Status: SUCCESS [ 1001.332944] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2d7b5b77-fadf-41e0-8ec9-a51ed0af628a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.475202] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 in Status: SUCCESS [ 1002.475495] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.496820] env[70392]: INFO networking_nsxv3.common.synchronization [req-439d09b2-df0d-4b40-aea8-68e54aba3453 req-c788c1d0-c050-4421-bc6e-dee05552e333 tempest-ServersTestJSON-507292717 tempest-ServersTestJSON-507292717-project-member] Enqueued Resource ID: 19062702-bd29-4477-a732-5169f347b4da with Priority: HIGHEST for action security_group_members [ 1002.498205] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19062702-bd29-4477-a732-5169f347b4da with Priority: HIGHEST for action security_group_members [ 1002.498205] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-19062702-bd29-4477-a732-5169f347b4da taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.498205] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.498205] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.498567] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.498824] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.498961] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.499143] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.499418] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.499593] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.499732] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.715498] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce79170a-31ce-429e-8e08-a911557872f4 in Status: SUCCESS [ 1002.715498] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce79170a-31ce-429e-8e08-a911557872f4 deletion is rescheduled due to dependency. [ 1002.715498] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.760845] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b in Status: SUCCESS [ 1002.761234] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.762043] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.763018] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.763018] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.763018] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.763018] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.767362] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.767995] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.767995] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.769364] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.769364] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.769364] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.769364] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.769364] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.769364] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.769364] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.769705] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.769705] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.769705] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.769788] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.003587] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.003587] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.003587] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.003587] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.003587] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.004118] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.004118] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.004118] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.004329] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.004329] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.005814] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19062702-bd29-4477-a732-5169f347b4da already deleted. [ 1003.005814] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.237887] env[70392]: INFO networking_nsxv3.common.synchronization [req-a75502ad-b267-4d9c-bffc-165765867ede req-cafd42f5-c178-46e2-beef-3a9c88937633 tempest-ServersAdminTestJSON-721710769 tempest-ServersAdminTestJSON-721710769-project-member] Enqueued Resource ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 with Priority: HIGHEST for action security_group_members [ 1003.238264] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 with Priority: HIGHEST for action security_group_members [ 1003.238598] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-f54639a3-c11e-4833-b47a-e0b477c46dd5 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.238725] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.238795] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.238995] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.239241] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.239482] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.239482] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.239592] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.242914] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.242914] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f54639a3-c11e-4833-b47a-e0b477c46dd5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.276160] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b: rpc.has_security_group_logging(os_id): False [ 1003.296187] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.296187] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.298156] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.298156] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.332025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.332025] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.332025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.332025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.332025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.332025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.332025] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.332025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.332025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.332025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.332025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.332025] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.332025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.332025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.332845] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.332845] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.332845] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b is going to be updated. [ 1003.422487] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.422667] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.422809] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.422972] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.423233] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.440859] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b in Status: IN_PROGRESS for 2s [ 1003.499046] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-219 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.499046] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-219" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.499046] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-219" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.499046] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-219" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.499576] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.499576] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.499576] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.499782] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.499960] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.500169] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1003.500276] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1003.500395] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1003.500513] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1003.500627] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1003.500737] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1003.500882] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1003.522335] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1003.522335] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1003.522506] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1003.522603] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-219" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.523028] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-bf1ce9b4-4f54-4668-90e6-9b70dde2603b taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.523302] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-bf1ce9b4-4f54-4668-90e6-9b70dde2603b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.525320] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-bf1ce9b4-4f54-4668-90e6-9b70dde2603b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.525584] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-bf1ce9b4-4f54-4668-90e6-9b70dde2603b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.525803] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf1ce9b4-4f54-4668-90e6-9b70dde2603b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.742970] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f54639a3-c11e-4833-b47a-e0b477c46dd5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.028541] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.028899] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.028899] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.029194] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.029359] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.029531] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port bf1ce9b4-4f54-4668-90e6-9b70dde2603b not found, creating... [ 1004.029775] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.029938] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.030068] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.030331] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.030511] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.030812] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.030972] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.031167] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.031391] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.031528] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.031670] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: bf1ce9b4-4f54-4668-90e6-9b70dde2603b is going to be created. [ 1004.055446] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.055789] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.055789] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.059150] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.059150] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.059150] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-bf1ce9b4-4f54-4668-90e6-9b70dde2603b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.246830] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f54639a3-c11e-4833-b47a-e0b477c46dd5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.749405] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.749748] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.749748] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.749853] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.749942] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.750096] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 is going to be updated. [ 1004.782942] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.782942] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.782942] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.782942] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.782942] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.795756] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 in Status: IN_PROGRESS for 2s [ 1004.993579] env[70392]: INFO networking_nsxv3.common.synchronization [req-439d09b2-df0d-4b40-aea8-68e54aba3453 req-d4231a60-7196-41fe-95db-53863387d129 service nova] Enqueued Resource ID: 19062702-bd29-4477-a732-5169f347b4da with Priority: HIGHEST for action security_group_rules [ 1004.993774] env[70392]: INFO networking_nsxv3.common.synchronization [req-439d09b2-df0d-4b40-aea8-68e54aba3453 req-d4231a60-7196-41fe-95db-53863387d129 service nova] Enqueued Resource ID: 19062702-bd29-4477-a732-5169f347b4da with Priority: HIGHEST for action security_group_members [ 1004.993966] env[70392]: INFO networking_nsxv3.common.synchronization [req-439d09b2-df0d-4b40-aea8-68e54aba3453 req-d4231a60-7196-41fe-95db-53863387d129 service nova] Enqueued Resource ID: bf1ce9b4-4f54-4668-90e6-9b70dde2603b with Priority: HIGHEST for action port [ 1004.994705] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19062702-bd29-4477-a732-5169f347b4da with Priority: HIGHEST for action security_group_rules [ 1004.994842] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19062702-bd29-4477-a732-5169f347b4da with Priority: HIGHEST for action security_group_members [ 1004.995038] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf1ce9b4-4f54-4668-90e6-9b70dde2603b with Priority: HIGHEST for action port [ 1004.995326] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-19062702-bd29-4477-a732-5169f347b4da taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.995457] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.995527] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.995793] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.995922] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.000313] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-19062702-bd29-4477-a732-5169f347b4da taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.000313] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.000313] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.000313] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.000313] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.000313] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.000313] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.000313] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.000313] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.000313] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.000313] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf1ce9b4-4f54-4668-90e6-9b70dde2603b taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.000313] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf1ce9b4-4f54-4668-90e6-9b70dde2603b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.000313] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf1ce9b4-4f54-4668-90e6-9b70dde2603b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.001011] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf1ce9b4-4f54-4668-90e6-9b70dde2603b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.001011] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf1ce9b4-4f54-4668-90e6-9b70dde2603b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.332801] env[70392]: INFO networking_nsxv3.common.synchronization [req-7bc42420-8f16-4084-9038-221a46af7da6 req-2bdbf062-3a0e-4e6c-9ce0-332f4af275c7 tempest-ImagesOneServerNegativeTestJSON-1691594958 tempest-ImagesOneServerNegativeTestJSON-1691594958-project-member] Enqueued Resource ID: dbeb3b19-0a8e-4685-84e0-239c82418063 with Priority: HIGHEST for action security_group_members [ 1005.334086] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbeb3b19-0a8e-4685-84e0-239c82418063 with Priority: HIGHEST for action security_group_members [ 1005.334086] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbeb3b19-0a8e-4685-84e0-239c82418063 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.336731] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.336872] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.337772] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.337997] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.338188] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.338272] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.338397] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.338488] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.338586] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbeb3b19-0a8e-4685-84e0-239c82418063',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.459415] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b in Status: SUCCESS [ 1005.459415] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.504054] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-19062702-bd29-4477-a732-5169f347b4da taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.504054] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.504054] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.504405] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bf1ce9b4-4f54-4668-90e6-9b70dde2603b with status ACTIVE [ 1005.504832] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.505033] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.505152] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.505399] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.505515] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.505742] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.506659] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.506659] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.506659] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.506659] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.506659] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.506659] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.506659] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.507053] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.507053] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.507053] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bf1ce9b4-4f54-4668-90e6-9b70dde2603b is going to be updated. [ 1005.532854] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.533162] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.533162] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.534368] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.534368] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.534368] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf1ce9b4-4f54-4668-90e6-9b70dde2603b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.844528] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.844528] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.844528] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.844837] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.870935] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-686 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.871727] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-686" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.871727] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-686" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.871727] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-686" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.871898] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.872215] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.872322] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.872579] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.872726] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.873038] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1005.873258] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1005.873720] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1005.873720] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1005.875252] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1005.875252] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1005.875252] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1005.877179] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.877420] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.877534] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.877602] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.877808] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.877925] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.877997] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbeb3b19-0a8e-4685-84e0-239c82418063 is going to be updated. [ 1005.901818] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1005.902085] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1005.902269] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1005.902485] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-686" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.902839] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-3054fa1f-ca1c-4e5d-9a1c-8f8dd7ace526 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.903066] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-3054fa1f-ca1c-4e5d-9a1c-8f8dd7ace526" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.903290] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-3054fa1f-ca1c-4e5d-9a1c-8f8dd7ace526" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.903641] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-3054fa1f-ca1c-4e5d-9a1c-8f8dd7ace526" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.903791] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3054fa1f-ca1c-4e5d-9a1c-8f8dd7ace526',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.918601] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.918785] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.918825] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.919046] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.919367] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.930506] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbeb3b19-0a8e-4685-84e0-239c82418063 in Status: IN_PROGRESS for 2s [ 1006.010572] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.407153] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.407837] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.407837] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.408046] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.408686] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.408686] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 3054fa1f-ca1c-4e5d-9a1c-8f8dd7ace526 not found, creating... [ 1006.408933] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.409143] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.409348] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.409569] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.409742] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.410079] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.411154] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.411154] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.411154] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.411154] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.411154] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 3054fa1f-ca1c-4e5d-9a1c-8f8dd7ace526 is going to be created. [ 1006.512517] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.512517] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.512517] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.512806] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.512849] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.514093] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19062702-bd29-4477-a732-5169f347b4da is going to be created. [ 1006.588486] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.588756] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.588895] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.589230] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.589532] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.589788] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-3054fa1f-ca1c-4e5d-9a1c-8f8dd7ace526" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.595285] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.595461] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.595651] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.595901] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.596078] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.610496] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19062702-bd29-4477-a732-5169f347b4da in Status: UNINITIALIZED for 2s [ 1006.812925] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 in Status: SUCCESS [ 1006.812925] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.576763] env[70392]: INFO networking_nsxv3.common.synchronization [req-a8bbb3a8-8eff-40e8-a994-142e1c9dff14 req-e50d1f5e-dfce-410e-931e-4e5a89c731fa tempest-ServersWithSpecificFlavorTestJSON-1944551370 tempest-ServersWithSpecificFlavorTestJSON-1944551370-project-member] Enqueued Resource ID: 7f78f149-d978-4089-8aa8-d480e7d7bb61 with Priority: HIGHEST for action security_group_members [ 1007.577939] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f78f149-d978-4089-8aa8-d480e7d7bb61 with Priority: HIGHEST for action security_group_members [ 1007.579396] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f78f149-d978-4089-8aa8-d480e7d7bb61 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.579527] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f78f149-d978-4089-8aa8-d480e7d7bb61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.579592] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f78f149-d978-4089-8aa8-d480e7d7bb61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.579801] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f78f149-d978-4089-8aa8-d480e7d7bb61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.579981] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.580098] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.580160] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.580465] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.580465] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.580585] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f78f149-d978-4089-8aa8-d480e7d7bb61',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.643306] env[70392]: INFO networking_nsxv3.common.synchronization [req-7bc42420-8f16-4084-9038-221a46af7da6 req-592a6c74-4333-4968-9d18-650f6af87f82 service nova] Enqueued Resource ID: dbeb3b19-0a8e-4685-84e0-239c82418063 with Priority: HIGHEST for action security_group_rules [ 1007.645191] env[70392]: INFO networking_nsxv3.common.synchronization [req-7bc42420-8f16-4084-9038-221a46af7da6 req-592a6c74-4333-4968-9d18-650f6af87f82 service nova] Enqueued Resource ID: dbeb3b19-0a8e-4685-84e0-239c82418063 with Priority: HIGHEST for action security_group_members [ 1007.645191] env[70392]: INFO networking_nsxv3.common.synchronization [req-7bc42420-8f16-4084-9038-221a46af7da6 req-592a6c74-4333-4968-9d18-650f6af87f82 service nova] Enqueued Resource ID: 3054fa1f-ca1c-4e5d-9a1c-8f8dd7ace526 with Priority: HIGHEST for action port [ 1007.645191] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbeb3b19-0a8e-4685-84e0-239c82418063 with Priority: HIGHEST for action security_group_rules [ 1007.645191] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbeb3b19-0a8e-4685-84e0-239c82418063 with Priority: HIGHEST for action security_group_members [ 1007.645191] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3054fa1f-ca1c-4e5d-9a1c-8f8dd7ace526 with Priority: HIGHEST for action port [ 1007.645191] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dbeb3b19-0a8e-4685-84e0-239c82418063 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.645191] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.645191] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.645687] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.645687] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dbeb3b19-0a8e-4685-84e0-239c82418063',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.646434] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbeb3b19-0a8e-4685-84e0-239c82418063 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.646536] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.646712] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-3054fa1f-ca1c-4e5d-9a1c-8f8dd7ace526 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.646808] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3054fa1f-ca1c-4e5d-9a1c-8f8dd7ace526" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.646870] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3054fa1f-ca1c-4e5d-9a1c-8f8dd7ace526" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.647060] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3054fa1f-ca1c-4e5d-9a1c-8f8dd7ace526" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.647372] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3054fa1f-ca1c-4e5d-9a1c-8f8dd7ace526',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.928029] env[70392]: INFO networking_nsxv3.common.synchronization [req-ffe03a79-570f-4d6d-9339-85546ca8b8ef req-8e5b4a1e-6e82-44e6-81a7-b567f74ed107 tempest-MultipleCreateTestJSON-1646981689 tempest-MultipleCreateTestJSON-1646981689-project-member] Enqueued Resource ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 with Priority: HIGHEST for action security_group_members [ 1007.928029] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 with Priority: HIGHEST for action security_group_members [ 1007.928029] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-20f5b49b-d835-491d-a710-e2565f4af8b5 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.928029] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.928029] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.934028] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.934028] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.934028] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.934028] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.934028] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.934028] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.934028] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20f5b49b-d835-491d-a710-e2565f4af8b5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.944440] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbeb3b19-0a8e-4685-84e0-239c82418063 in Status: SUCCESS [ 1007.944757] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbeb3b19-0a8e-4685-84e0-239c82418063 deletion is rescheduled due to dependency. [ 1007.944915] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.945569] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.945830] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.946382] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.946382] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.946382] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.946645] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.946812] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.946970] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbeb3b19-0a8e-4685-84e0-239c82418063',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.082878] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.083129] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.083288] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.083511] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.111605] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.111931] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.112053] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.112152] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.112360] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.112450] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.112543] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f78f149-d978-4089-8aa8-d480e7d7bb61 is going to be updated. [ 1008.115389] env[70392]: INFO networking_nsxv3.common.synchronization [req-6449900d-2acd-4c9e-a489-30797e85101b req-bc1dfbd0-37bd-4166-ab76-4e9c4957dba8 tempest-ServerActionsTestOtherA-1411478130 tempest-ServerActionsTestOtherA-1411478130-project-member] Enqueued Resource ID: f5251c5e-578a-48aa-8195-e1dc88834ad8 with Priority: HIGHEST for action security_group_members [ 1008.116102] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5251c5e-578a-48aa-8195-e1dc88834ad8 with Priority: HIGHEST for action security_group_members [ 1008.116986] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5251c5e-578a-48aa-8195-e1dc88834ad8 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.118209] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5251c5e-578a-48aa-8195-e1dc88834ad8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.118209] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5251c5e-578a-48aa-8195-e1dc88834ad8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.118480] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5251c5e-578a-48aa-8195-e1dc88834ad8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.118696] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.119019] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.119019] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.119138] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.119556] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.119556] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5251c5e-578a-48aa-8195-e1dc88834ad8',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.149250] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbeb3b19-0a8e-4685-84e0-239c82418063 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.149433] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.153250] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3054fa1f-ca1c-4e5d-9a1c-8f8dd7ace526 with status ACTIVE [ 1008.154148] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.154148] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.154148] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.154148] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.154148] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.154452] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.154502] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.154536] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.158328] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.158437] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.158684] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.158797] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.158861] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.159047] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.159127] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.159218] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3054fa1f-ca1c-4e5d-9a1c-8f8dd7ace526 is going to be updated. [ 1008.161133] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.161294] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.161330] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.161502] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.161638] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.172553] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f78f149-d978-4089-8aa8-d480e7d7bb61 in Status: IN_PROGRESS for 2s [ 1008.185043] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.185187] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.185266] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.185500] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.185647] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.185817] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3054fa1f-ca1c-4e5d-9a1c-8f8dd7ace526" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.424617] env[70392]: INFO networking_nsxv3.common.synchronization [req-84b35446-6c6f-4c6e-8681-6e475a848b70 req-5031d2c5-93c8-41c3-ad3d-869a4b1e8595 tempest-MultipleCreateTestJSON-1646981689 tempest-MultipleCreateTestJSON-1646981689-project-member] Enqueued Resource ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 with Priority: HIGHEST for action security_group_members [ 1008.424617] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 with Priority: HIGHEST for action security_group_members [ 1008.432243] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-20f5b49b-d835-491d-a710-e2565f4af8b5 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.432448] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.438962] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('20f5b49b-d835-491d-a710-e2565f4af8b5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.454529] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dbeb3b19-0a8e-4685-84e0-239c82418063',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.621674] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19062702-bd29-4477-a732-5169f347b4da in Status: SUCCESS [ 1008.622726] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.622726] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.622726] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.622726] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.623017] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.623109] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.623403] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.623506] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.623665] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.623738] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.623837] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.623891] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5251c5e-578a-48aa-8195-e1dc88834ad8 already deleted. [ 1008.623975] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5251c5e-578a-48aa-8195-e1dc88834ad8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.628541] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.628855] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.629755] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.629755] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.629755] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.629755] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.629755] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.629755] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.630034] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.633706] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-844 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.633930] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-844" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.634223] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-844" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.634326] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-844" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.635049] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.635049] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.635049] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.635301] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.635356] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.635567] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1008.635712] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1008.635851] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1008.635950] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1008.636077] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1008.636192] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1008.637149] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1008.658268] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1008.658268] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1008.658268] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1008.658268] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-844" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.658268] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-9cb10db7-8542-468f-9d75-b5486da04904 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.658268] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-9cb10db7-8542-468f-9d75-b5486da04904" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.658268] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-9cb10db7-8542-468f-9d75-b5486da04904" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.658575] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-9cb10db7-8542-468f-9d75-b5486da04904" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.658666] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9cb10db7-8542-468f-9d75-b5486da04904',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.937825] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('20f5b49b-d835-491d-a710-e2565f4af8b5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.956873] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dbeb3b19-0a8e-4685-84e0-239c82418063',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.138951] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-19062702-bd29-4477-a732-5169f347b4da taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.139112] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.139231] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.139590] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.139742] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.139926] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.139926] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.140139] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.140231] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.140327] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.140451] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-19062702-bd29-4477-a732-5169f347b4da taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.140684] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.140684] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.140892] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.140991] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.141171] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.141248] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.141418] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.141479] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.141585] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.141862] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.161882] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.162149] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.162617] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.162617] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.162824] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.163087] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 9cb10db7-8542-468f-9d75-b5486da04904 not found, creating... [ 1009.163491] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.163798] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.163798] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.164244] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.164455] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.164866] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.165093] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.165265] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.165505] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.165724] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.165912] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 9cb10db7-8542-468f-9d75-b5486da04904 is going to be created. [ 1009.207253] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.207623] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.207758] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.208154] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.209286] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.209669] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-9cb10db7-8542-468f-9d75-b5486da04904" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.440401] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.440595] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.440595] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.440784] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.440885] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.441056] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 is going to be updated. [ 1009.459591] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.459782] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.459876] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.460209] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.460341] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.460459] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbeb3b19-0a8e-4685-84e0-239c82418063 is going to be updated. [ 1009.481700] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.482871] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.483090] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.483438] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.484316] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.495323] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 in Status: IN_PROGRESS for 2s [ 1009.503870] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.504032] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.504106] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.504496] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.504749] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.516672] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbeb3b19-0a8e-4685-84e0-239c82418063 in Status: IN_PROGRESS for 2s [ 1009.647513] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 19062702-bd29-4477-a732-5169f347b4da: rpc.has_security_group_logging(os_id): False [ 1009.670967] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.671171] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.671431] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.671501] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.671565] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.671826] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.671920] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.672014] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.672150] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.672329] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.672515] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.672608] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.672670] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.672812] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.672886] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.675053] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.675468] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.675468] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.675468] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.675682] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.675682] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 19062702-bd29-4477-a732-5169f347b4da is going to be created. [ 1009.741472] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.741669] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.741749] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.741985] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.742265] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.756815] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 19062702-bd29-4477-a732-5169f347b4da in Status: IN_PROGRESS for 2s [ 1009.928677] env[70392]: INFO networking_nsxv3.common.synchronization [None req-bc4eb5e9-5da6-4a2c-856c-7333615c829c None None] Enqueued Resource ID: fcf17664-4bc8-4aa5-9466-3d4569f99b73 with Priority: HIGHEST for action port [ 1009.929375] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcf17664-4bc8-4aa5-9466-3d4569f99b73 with Priority: HIGHEST for action port [ 1009.929828] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-fcf17664-4bc8-4aa5-9466-3d4569f99b73 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.929972] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fcf17664-4bc8-4aa5-9466-3d4569f99b73" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.930473] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fcf17664-4bc8-4aa5-9466-3d4569f99b73" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.930769] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fcf17664-4bc8-4aa5-9466-3d4569f99b73" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.930906] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fcf17664-4bc8-4aa5-9466-3d4569f99b73',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.188149] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f78f149-d978-4089-8aa8-d480e7d7bb61 in Status: SUCCESS [ 1010.188353] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f78f149-d978-4089-8aa8-d480e7d7bb61 deletion is rescheduled due to dependency. [ 1010.188493] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f78f149-d978-4089-8aa8-d480e7d7bb61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.264028] env[70392]: INFO networking_nsxv3.common.synchronization [req-6449900d-2acd-4c9e-a489-30797e85101b req-afa0d823-075f-4d88-91b8-d5ff1b5e19e7 service nova] Enqueued Resource ID: f5251c5e-578a-48aa-8195-e1dc88834ad8 with Priority: HIGHEST for action security_group_rules [ 1010.264268] env[70392]: INFO networking_nsxv3.common.synchronization [req-6449900d-2acd-4c9e-a489-30797e85101b req-afa0d823-075f-4d88-91b8-d5ff1b5e19e7 service nova] Enqueued Resource ID: f5251c5e-578a-48aa-8195-e1dc88834ad8 with Priority: HIGHEST for action security_group_members [ 1010.264456] env[70392]: INFO networking_nsxv3.common.synchronization [req-6449900d-2acd-4c9e-a489-30797e85101b req-afa0d823-075f-4d88-91b8-d5ff1b5e19e7 service nova] Enqueued Resource ID: 9cb10db7-8542-468f-9d75-b5486da04904 with Priority: HIGHEST for action port [ 1010.265152] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5251c5e-578a-48aa-8195-e1dc88834ad8 with Priority: HIGHEST for action security_group_rules [ 1010.265319] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5251c5e-578a-48aa-8195-e1dc88834ad8 with Priority: HIGHEST for action security_group_members [ 1010.265434] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cb10db7-8542-468f-9d75-b5486da04904 with Priority: HIGHEST for action port [ 1010.265773] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f5251c5e-578a-48aa-8195-e1dc88834ad8 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.265917] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f5251c5e-578a-48aa-8195-e1dc88834ad8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.265987] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f5251c5e-578a-48aa-8195-e1dc88834ad8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.266295] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f5251c5e-578a-48aa-8195-e1dc88834ad8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.266392] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f5251c5e-578a-48aa-8195-e1dc88834ad8',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.267373] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5251c5e-578a-48aa-8195-e1dc88834ad8 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.270635] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5251c5e-578a-48aa-8195-e1dc88834ad8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.270635] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5251c5e-578a-48aa-8195-e1dc88834ad8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.270635] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5251c5e-578a-48aa-8195-e1dc88834ad8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.270635] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.270635] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.270635] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.270635] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.270635] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.270635] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5251c5e-578a-48aa-8195-e1dc88834ad8',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.270635] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-9cb10db7-8542-468f-9d75-b5486da04904 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.270635] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9cb10db7-8542-468f-9d75-b5486da04904" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.270635] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9cb10db7-8542-468f-9d75-b5486da04904" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.270635] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9cb10db7-8542-468f-9d75-b5486da04904" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.270635] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9cb10db7-8542-468f-9d75-b5486da04904',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.433808] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fcf17664-4bc8-4aa5-9466-3d4569f99b73 [ 1010.434069] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.434215] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.434302] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.434685] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.434786] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.434896] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fcf17664-4bc8-4aa5-9466-3d4569f99b73 already deleted. [ 1010.434986] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fcf17664-4bc8-4aa5-9466-3d4569f99b73" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.771347] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5251c5e-578a-48aa-8195-e1dc88834ad8 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.771739] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5251c5e-578a-48aa-8195-e1dc88834ad8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.772902] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f5251c5e-578a-48aa-8195-e1dc88834ad8',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.773932] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9cb10db7-8542-468f-9d75-b5486da04904 with status ACTIVE [ 1010.774155] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.774279] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.774348] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.774547] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.774636] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.774813] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.774907] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.774969] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.775125] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.775202] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.775378] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.775476] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.775535] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.775699] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.775774] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.775856] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9cb10db7-8542-468f-9d75-b5486da04904 is going to be updated. [ 1010.822081] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.822081] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.822081] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.822081] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.822081] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.822081] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9cb10db7-8542-468f-9d75-b5486da04904" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.922934] env[70392]: INFO networking_nsxv3.common.synchronization [req-c65b3eb1-faad-462e-a0fb-e3659b34a192 req-d9cf083f-8f86-4ff8-8542-cd8950b32526 tempest-AttachVolumeNegativeTest-772339566 tempest-AttachVolumeNegativeTest-772339566-project-member] Enqueued Resource ID: 43327972-df6d-4e69-b782-fda3a340af0a with Priority: HIGHEST for action security_group_members [ 1010.923753] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43327972-df6d-4e69-b782-fda3a340af0a with Priority: HIGHEST for action security_group_members [ 1010.924388] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-43327972-df6d-4e69-b782-fda3a340af0a taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.924590] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43327972-df6d-4e69-b782-fda3a340af0a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.924684] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43327972-df6d-4e69-b782-fda3a340af0a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.925092] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43327972-df6d-4e69-b782-fda3a340af0a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.925561] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.925758] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.925865] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.926332] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.926408] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.926515] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43327972-df6d-4e69-b782-fda3a340af0a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.279288] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f5251c5e-578a-48aa-8195-e1dc88834ad8',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.431538] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.431757] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.431833] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.432188] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.432336] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.432642] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.432787] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.432870] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.433076] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.433175] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.433296] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43327972-df6d-4e69-b782-fda3a340af0a already deleted. [ 1011.433382] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43327972-df6d-4e69-b782-fda3a340af0a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.511376] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 in Status: SUCCESS [ 1011.511978] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.512097] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.512343] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.512741] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.512951] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.513071] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.513409] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.514114] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.514114] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20f5b49b-d835-491d-a710-e2565f4af8b5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.528865] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbeb3b19-0a8e-4685-84e0-239c82418063 in Status: SUCCESS [ 1011.529188] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.529364] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.529963] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.530227] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.530406] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.530406] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.530619] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.530718] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.530757] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.531836] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dbeb3b19-0a8e-4685-84e0-239c82418063',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.582468] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-483 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.582908] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-483" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.582908] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-483" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.585411] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-483" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.585411] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.585590] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.586744] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.586744] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.586744] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.586744] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1011.586933] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1011.587024] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1011.587205] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1011.587371] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1011.587559] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1011.587781] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1011.614412] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1011.614963] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1011.615306] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1011.615758] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-483" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.616141] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-6d0d6bb9-4498-4b10-a91c-1ba34e58cb49 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.616352] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-6d0d6bb9-4498-4b10-a91c-1ba34e58cb49" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.616485] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-6d0d6bb9-4498-4b10-a91c-1ba34e58cb49" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.616832] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-6d0d6bb9-4498-4b10-a91c-1ba34e58cb49" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.616999] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d0d6bb9-4498-4b10-a91c-1ba34e58cb49',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.772607] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 19062702-bd29-4477-a732-5169f347b4da in Status: SUCCESS [ 1011.772981] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.786931] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.786931] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.786931] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.786931] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.786931] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.786931] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5251c5e-578a-48aa-8195-e1dc88834ad8 is going to be created. [ 1011.816879] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.819418] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.819418] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.819418] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.819418] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.832873] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5251c5e-578a-48aa-8195-e1dc88834ad8 in Status: UNINITIALIZED for 2s [ 1011.959231] env[70392]: INFO networking_nsxv3.common.synchronization [None req-03f7c92f-7be2-4093-9dc5-cf7f81a5834e None None] Enqueued Resource ID: d51649ad-3e6e-4c5f-b325-dbfe6eddf10b with Priority: HIGHEST for action port [ 1011.959873] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d51649ad-3e6e-4c5f-b325-dbfe6eddf10b with Priority: HIGHEST for action port [ 1011.960199] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-d51649ad-3e6e-4c5f-b325-dbfe6eddf10b taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.960342] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d51649ad-3e6e-4c5f-b325-dbfe6eddf10b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.960414] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d51649ad-3e6e-4c5f-b325-dbfe6eddf10b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.960686] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d51649ad-3e6e-4c5f-b325-dbfe6eddf10b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.960838] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d51649ad-3e6e-4c5f-b325-dbfe6eddf10b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.016612] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.016832] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.016953] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.017308] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.017308] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.017585] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.017720] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.017812] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.018026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.018117] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.018245] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 is going to be updated. [ 1012.038674] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbeb3b19-0a8e-4685-84e0-239c82418063 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.038674] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.038674] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.038674] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.039163] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.039357] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.039427] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.039582] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.039710] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.040293] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.040577] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbeb3b19-0a8e-4685-84e0-239c82418063 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.040769] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.040867] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.041069] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.041602] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.041828] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.041920] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.042117] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.042235] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.042436] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.042618] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dbeb3b19-0a8e-4685-84e0-239c82418063',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.090990] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.091456] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.091899] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.092296] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.092630] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.104250] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 in Status: IN_PROGRESS for 2s [ 1012.119600] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.119848] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.119967] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.120326] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.120505] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.120667] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 6d0d6bb9-4498-4b10-a91c-1ba34e58cb49 not found, creating... [ 1012.120941] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.121133] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.121377] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.121647] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.121879] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.122545] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.122785] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.122947] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.123333] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.123564] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.123760] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 6d0d6bb9-4498-4b10-a91c-1ba34e58cb49 is going to be created. [ 1012.172015] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.172015] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.172015] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.172015] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.172015] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.172368] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-6d0d6bb9-4498-4b10-a91c-1ba34e58cb49" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.463818] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d51649ad-3e6e-4c5f-b325-dbfe6eddf10b [ 1012.464233] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.464483] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.464672] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.465284] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.465456] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.465679] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d51649ad-3e6e-4c5f-b325-dbfe6eddf10b already deleted. [ 1012.465870] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d51649ad-3e6e-4c5f-b325-dbfe6eddf10b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.545987] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dbeb3b19-0a8e-4685-84e0-239c82418063: rpc.has_security_group_logging(os_id): False [ 1012.566377] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.566517] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.566584] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.566856] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.566962] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.567104] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.567204] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.567258] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.567434] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.567532] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.567780] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.567885] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.567950] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.568107] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.568184] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.568374] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.568464] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.568526] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.568667] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.568742] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.568827] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dbeb3b19-0a8e-4685-84e0-239c82418063 is going to be updated. [ 1012.640270] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.640437] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.640533] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.640753] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.641048] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.656622] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dbeb3b19-0a8e-4685-84e0-239c82418063 in Status: IN_PROGRESS for 2s [ 1012.962679] env[70392]: INFO networking_nsxv3.common.synchronization [req-c65b3eb1-faad-462e-a0fb-e3659b34a192 req-466df1ce-2668-4fa7-99a2-aca42cff8688 service nova] Enqueued Resource ID: 43327972-df6d-4e69-b782-fda3a340af0a with Priority: HIGHEST for action security_group_rules [ 1012.963040] env[70392]: INFO networking_nsxv3.common.synchronization [req-c65b3eb1-faad-462e-a0fb-e3659b34a192 req-466df1ce-2668-4fa7-99a2-aca42cff8688 service nova] Enqueued Resource ID: 43327972-df6d-4e69-b782-fda3a340af0a with Priority: HIGHEST for action security_group_members [ 1012.963040] env[70392]: INFO networking_nsxv3.common.synchronization [req-c65b3eb1-faad-462e-a0fb-e3659b34a192 req-466df1ce-2668-4fa7-99a2-aca42cff8688 service nova] Enqueued Resource ID: 6d0d6bb9-4498-4b10-a91c-1ba34e58cb49 with Priority: HIGHEST for action port [ 1012.963264] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43327972-df6d-4e69-b782-fda3a340af0a with Priority: HIGHEST for action security_group_rules [ 1012.963412] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43327972-df6d-4e69-b782-fda3a340af0a with Priority: HIGHEST for action security_group_members [ 1012.963538] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d0d6bb9-4498-4b10-a91c-1ba34e58cb49 with Priority: HIGHEST for action port [ 1012.969097] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-43327972-df6d-4e69-b782-fda3a340af0a taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.969097] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-43327972-df6d-4e69-b782-fda3a340af0a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.969097] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-43327972-df6d-4e69-b782-fda3a340af0a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.969097] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-43327972-df6d-4e69-b782-fda3a340af0a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.969097] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('43327972-df6d-4e69-b782-fda3a340af0a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.969097] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-43327972-df6d-4e69-b782-fda3a340af0a taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.969097] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43327972-df6d-4e69-b782-fda3a340af0a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.969097] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43327972-df6d-4e69-b782-fda3a340af0a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.969097] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43327972-df6d-4e69-b782-fda3a340af0a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.969097] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.969097] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.969480] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.969480] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.969480] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.969480] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43327972-df6d-4e69-b782-fda3a340af0a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.973061] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-6d0d6bb9-4498-4b10-a91c-1ba34e58cb49 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.973061] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6d0d6bb9-4498-4b10-a91c-1ba34e58cb49" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.973061] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6d0d6bb9-4498-4b10-a91c-1ba34e58cb49" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.973061] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6d0d6bb9-4498-4b10-a91c-1ba34e58cb49" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.973061] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d0d6bb9-4498-4b10-a91c-1ba34e58cb49',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.472586] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('43327972-df6d-4e69-b782-fda3a340af0a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.476987] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-43327972-df6d-4e69-b782-fda3a340af0a taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.476987] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43327972-df6d-4e69-b782-fda3a340af0a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.478526] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6d0d6bb9-4498-4b10-a91c-1ba34e58cb49 with status ACTIVE [ 1013.478526] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.478526] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.478526] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.478526] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.478526] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.478817] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.478817] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.478985] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.479408] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.479583] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.479897] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.480147] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.480222] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.480398] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.480477] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.480588] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6d0d6bb9-4498-4b10-a91c-1ba34e58cb49 is going to be updated. [ 1013.511353] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.511640] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.511707] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.511910] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.512332] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.512332] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6d0d6bb9-4498-4b10-a91c-1ba34e58cb49" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.670308] env[70392]: INFO networking_nsxv3.common.synchronization [req-876efc93-4280-4be9-aebe-30c874fb462b req-d3531889-1da0-4b13-b759-c24b6b405b07 tempest-ServerDiskConfigTestJSON-277542510 tempest-ServerDiskConfigTestJSON-277542510-project-member] Enqueued Resource ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 with Priority: HIGHEST for action security_group_members [ 1013.670840] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 with Priority: HIGHEST for action security_group_members [ 1013.671153] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60d7eaa-9583-4c75-97fa-4049c63576b6 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.671322] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.671379] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.671603] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.671723] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.671817] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.671876] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.672029] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.672113] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.672203] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b60d7eaa-9583-4c75-97fa-4049c63576b6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.848260] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5251c5e-578a-48aa-8195-e1dc88834ad8 in Status: SUCCESS [ 1013.848260] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5251c5e-578a-48aa-8195-e1dc88834ad8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.848260] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5251c5e-578a-48aa-8195-e1dc88834ad8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.848260] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5251c5e-578a-48aa-8195-e1dc88834ad8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.848260] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.848260] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.848260] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.848260] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.848260] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.848260] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5251c5e-578a-48aa-8195-e1dc88834ad8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.848260] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f5251c5e-578a-48aa-8195-e1dc88834ad8',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.975230] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('43327972-df6d-4e69-b782-fda3a340af0a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.071195] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-256 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.071195] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-256" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.071195] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-256" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.071195] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-256" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.071461] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.071876] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.072136] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.072602] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.072941] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.073344] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1014.073669] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1014.073885] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1014.074100] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1014.074350] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1014.074573] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1014.074845] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1014.097646] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1014.097893] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1014.098344] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1014.098619] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-256" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.098967] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-a2005298-430b-4eb0-a4dc-24891dbf18a9 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.099161] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-a2005298-430b-4eb0-a4dc-24891dbf18a9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.099314] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-a2005298-430b-4eb0-a4dc-24891dbf18a9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.099663] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-a2005298-430b-4eb0-a4dc-24891dbf18a9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.099810] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2005298-430b-4eb0-a4dc-24891dbf18a9',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.117207] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 in Status: SUCCESS [ 1014.117323] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 deletion is rescheduled due to dependency. [ 1014.117437] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.177870] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.178051] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.178108] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.178325] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.198822] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.199175] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.199276] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.199312] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.199511] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.199599] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.199694] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 is going to be updated. [ 1014.244400] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.244562] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.244622] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.244842] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.244985] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.256848] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 in Status: IN_PROGRESS for 2s [ 1014.351777] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5251c5e-578a-48aa-8195-e1dc88834ad8 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.356018] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5251c5e-578a-48aa-8195-e1dc88834ad8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.356018] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5251c5e-578a-48aa-8195-e1dc88834ad8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.356018] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5251c5e-578a-48aa-8195-e1dc88834ad8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.356018] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.356018] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.356018] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.356018] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.356018] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.356018] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5251c5e-578a-48aa-8195-e1dc88834ad8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.356018] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5251c5e-578a-48aa-8195-e1dc88834ad8 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.356018] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5251c5e-578a-48aa-8195-e1dc88834ad8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.356018] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5251c5e-578a-48aa-8195-e1dc88834ad8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.356018] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5251c5e-578a-48aa-8195-e1dc88834ad8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.356018] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.356018] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.356018] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.356018] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.356018] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.356742] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5251c5e-578a-48aa-8195-e1dc88834ad8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.356742] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f5251c5e-578a-48aa-8195-e1dc88834ad8',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.480255] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.480255] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.480255] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.480255] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.480255] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.480255] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43327972-df6d-4e69-b782-fda3a340af0a is going to be created. [ 1014.514038] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.514038] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.514038] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.514038] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.514038] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.525508] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43327972-df6d-4e69-b782-fda3a340af0a in Status: UNINITIALIZED for 2s [ 1014.607067] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.607478] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.607735] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.608183] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.608406] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.608653] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port a2005298-430b-4eb0-a4dc-24891dbf18a9 not found, creating... [ 1014.608990] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.609286] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.609384] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.609675] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.610022] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.610266] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.610706] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.610706] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.610900] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.611085] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.612476] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: a2005298-430b-4eb0-a4dc-24891dbf18a9 is going to be created. [ 1014.635722] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.636051] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.636210] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.636598] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.636903] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.637224] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-a2005298-430b-4eb0-a4dc-24891dbf18a9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.672621] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dbeb3b19-0a8e-4685-84e0-239c82418063 in Status: SUCCESS [ 1014.673082] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.862903] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f5251c5e-578a-48aa-8195-e1dc88834ad8: rpc.has_security_group_logging(os_id): False [ 1014.895053] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.895053] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.895053] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.895053] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.895053] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.895053] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.895053] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.895053] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.895053] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.895053] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.895053] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.895053] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.895053] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.895053] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.895053] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.895782] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.895782] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.895959] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.896067] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.896122] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.896663] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f5251c5e-578a-48aa-8195-e1dc88834ad8 is going to be created. [ 1014.974500] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.974700] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.974745] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.974922] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.975122] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.988298] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5251c5e-578a-48aa-8195-e1dc88834ad8 in Status: IN_PROGRESS for 2s [ 1015.528038] env[70392]: INFO networking_nsxv3.common.synchronization [req-876efc93-4280-4be9-aebe-30c874fb462b req-e75f4951-f991-4206-8418-eb642f238e44 service nova] Enqueued Resource ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 with Priority: HIGHEST for action security_group_rules [ 1015.528038] env[70392]: INFO networking_nsxv3.common.synchronization [req-876efc93-4280-4be9-aebe-30c874fb462b req-e75f4951-f991-4206-8418-eb642f238e44 service nova] Enqueued Resource ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 with Priority: HIGHEST for action security_group_members [ 1015.528038] env[70392]: INFO networking_nsxv3.common.synchronization [req-876efc93-4280-4be9-aebe-30c874fb462b req-e75f4951-f991-4206-8418-eb642f238e44 service nova] Enqueued Resource ID: a2005298-430b-4eb0-a4dc-24891dbf18a9 with Priority: HIGHEST for action port [ 1015.528038] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 with Priority: HIGHEST for action security_group_rules [ 1015.528038] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 with Priority: HIGHEST for action security_group_members [ 1015.528038] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2005298-430b-4eb0-a4dc-24891dbf18a9 with Priority: HIGHEST for action port [ 1015.528038] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b60d7eaa-9583-4c75-97fa-4049c63576b6 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.528038] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.528038] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.528038] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.528895] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b60d7eaa-9583-4c75-97fa-4049c63576b6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.529986] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60d7eaa-9583-4c75-97fa-4049c63576b6 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.530259] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.531859] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-a2005298-430b-4eb0-a4dc-24891dbf18a9 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.531859] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a2005298-430b-4eb0-a4dc-24891dbf18a9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.531859] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a2005298-430b-4eb0-a4dc-24891dbf18a9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.531859] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a2005298-430b-4eb0-a4dc-24891dbf18a9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.531859] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2005298-430b-4eb0-a4dc-24891dbf18a9',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.034551] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60d7eaa-9583-4c75-97fa-4049c63576b6 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.034867] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.034991] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a2005298-430b-4eb0-a4dc-24891dbf18a9 with status ACTIVE [ 1016.035051] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.035167] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.035235] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.035458] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.035553] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.035737] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.035835] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.035896] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.036172] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.036172] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.036312] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.036405] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.036468] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.036610] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.036685] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.036771] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a2005298-430b-4eb0-a4dc-24891dbf18a9 is going to be updated. [ 1016.065035] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.065035] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.065303] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.066200] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.066200] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.066200] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a2005298-430b-4eb0-a4dc-24891dbf18a9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.267859] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 in Status: SUCCESS [ 1016.268078] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 deletion is rescheduled due to dependency. [ 1016.268371] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.268371] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.268566] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.268753] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.268871] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.268937] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.269116] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.269187] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.269287] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b60d7eaa-9583-4c75-97fa-4049c63576b6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.535604] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43327972-df6d-4e69-b782-fda3a340af0a in Status: SUCCESS [ 1016.535938] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43327972-df6d-4e69-b782-fda3a340af0a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.536120] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43327972-df6d-4e69-b782-fda3a340af0a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.536506] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43327972-df6d-4e69-b782-fda3a340af0a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.536548] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.536672] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.536844] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.536883] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.536979] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.537095] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43327972-df6d-4e69-b782-fda3a340af0a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.537211] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('43327972-df6d-4e69-b782-fda3a340af0a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.560534] env[70392]: INFO networking_nsxv3.common.synchronization [req-20c13814-2a3b-4618-8b53-9d308fd139c5 req-c4639371-8f79-41f6-bf3d-cca7721bf3c2 tempest-AttachVolumeTestJSON-1272662447 tempest-AttachVolumeTestJSON-1272662447-project-member] Enqueued Resource ID: 2dfa1026-01a5-4176-a643-8ab1ceda5ce6 with Priority: HIGHEST for action security_group_members [ 1016.561722] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2dfa1026-01a5-4176-a643-8ab1ceda5ce6 with Priority: HIGHEST for action security_group_members [ 1016.562206] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-2dfa1026-01a5-4176-a643-8ab1ceda5ce6 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.562387] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2dfa1026-01a5-4176-a643-8ab1ceda5ce6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.562490] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2dfa1026-01a5-4176-a643-8ab1ceda5ce6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.562779] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2dfa1026-01a5-4176-a643-8ab1ceda5ce6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.562981] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.563168] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.563266] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.565405] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.565405] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.565405] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2dfa1026-01a5-4176-a643-8ab1ceda5ce6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.776214] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b60d7eaa-9583-4c75-97fa-4049c63576b6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.001857] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5251c5e-578a-48aa-8195-e1dc88834ad8 in Status: SUCCESS [ 1017.002104] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f5251c5e-578a-48aa-8195-e1dc88834ad8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.046357] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('43327972-df6d-4e69-b782-fda3a340af0a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.068493] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.069946] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.069946] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.069946] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.069946] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.069946] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.069946] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.069946] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.069946] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.069946] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.069946] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2dfa1026-01a5-4176-a643-8ab1ceda5ce6 already deleted. [ 1017.069946] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2dfa1026-01a5-4176-a643-8ab1ceda5ce6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.127777] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-423 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.127912] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-423" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.127912] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-423" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.128730] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-423" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.128730] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.128730] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.128925] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.129103] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.129887] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.129887] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1017.129887] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1017.129887] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1017.129887] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1017.130181] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1017.130181] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1017.131322] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1017.151881] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1017.151881] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1017.151881] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1017.151881] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-423" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.152136] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-bd69d784-9580-4fd5-b64a-9f8685f7f719 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.152212] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-bd69d784-9580-4fd5-b64a-9f8685f7f719" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.156057] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-bd69d784-9580-4fd5-b64a-9f8685f7f719" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.156057] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-bd69d784-9580-4fd5-b64a-9f8685f7f719" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.156057] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd69d784-9580-4fd5-b64a-9f8685f7f719',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.278569] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b60d7eaa-9583-4c75-97fa-4049c63576b6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.548928] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 43327972-df6d-4e69-b782-fda3a340af0a: rpc.has_security_group_logging(os_id): False [ 1017.568631] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.568851] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.568851] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.570620] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.570620] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.570620] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.570620] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.570620] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.570620] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.570620] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.570620] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 43327972-df6d-4e69-b782-fda3a340af0a is going to be created. [ 1017.659152] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.659152] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.659152] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.659152] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.659152] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.659152] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port bd69d784-9580-4fd5-b64a-9f8685f7f719 not found, creating... [ 1017.659644] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.659644] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.659722] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.661026] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.661026] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.662035] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.662035] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.662035] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.662035] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.663105] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.663105] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: bd69d784-9580-4fd5-b64a-9f8685f7f719 is going to be created. [ 1017.678037] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.678037] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.678037] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.678037] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.678037] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.693369] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 43327972-df6d-4e69-b782-fda3a340af0a in Status: IN_PROGRESS for 2s [ 1017.696765] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.697020] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.697020] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.697320] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.697591] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.697837] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-bd69d784-9580-4fd5-b64a-9f8685f7f719" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.780938] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.781193] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.781367] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.781644] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.781768] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.781883] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 is going to be updated. [ 1017.839955] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.840218] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.840218] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.840424] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.840612] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.856126] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 in Status: IN_PROGRESS for 2s [ 1018.600670] env[70392]: INFO networking_nsxv3.common.synchronization [req-20c13814-2a3b-4618-8b53-9d308fd139c5 req-de4e2ce9-9413-45ea-a4ec-041e280e300a service nova] Enqueued Resource ID: 2dfa1026-01a5-4176-a643-8ab1ceda5ce6 with Priority: HIGHEST for action security_group_rules [ 1018.600939] env[70392]: INFO networking_nsxv3.common.synchronization [req-20c13814-2a3b-4618-8b53-9d308fd139c5 req-de4e2ce9-9413-45ea-a4ec-041e280e300a service nova] Enqueued Resource ID: 2dfa1026-01a5-4176-a643-8ab1ceda5ce6 with Priority: HIGHEST for action security_group_members [ 1018.601012] env[70392]: INFO networking_nsxv3.common.synchronization [req-20c13814-2a3b-4618-8b53-9d308fd139c5 req-de4e2ce9-9413-45ea-a4ec-041e280e300a service nova] Enqueued Resource ID: bd69d784-9580-4fd5-b64a-9f8685f7f719 with Priority: HIGHEST for action port [ 1018.601588] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2dfa1026-01a5-4176-a643-8ab1ceda5ce6 with Priority: HIGHEST for action security_group_rules [ 1018.601773] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2dfa1026-01a5-4176-a643-8ab1ceda5ce6 with Priority: HIGHEST for action security_group_members [ 1018.602222] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd69d784-9580-4fd5-b64a-9f8685f7f719 with Priority: HIGHEST for action port [ 1018.602379] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2dfa1026-01a5-4176-a643-8ab1ceda5ce6 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.602543] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2dfa1026-01a5-4176-a643-8ab1ceda5ce6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.602617] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2dfa1026-01a5-4176-a643-8ab1ceda5ce6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.602875] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2dfa1026-01a5-4176-a643-8ab1ceda5ce6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.602943] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2dfa1026-01a5-4176-a643-8ab1ceda5ce6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.604303] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-2dfa1026-01a5-4176-a643-8ab1ceda5ce6 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.604435] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2dfa1026-01a5-4176-a643-8ab1ceda5ce6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.604539] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2dfa1026-01a5-4176-a643-8ab1ceda5ce6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.604715] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2dfa1026-01a5-4176-a643-8ab1ceda5ce6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.604894] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.604995] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.605099] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.605255] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.605349] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.605467] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2dfa1026-01a5-4176-a643-8ab1ceda5ce6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.607582] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-bd69d784-9580-4fd5-b64a-9f8685f7f719 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.607724] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bd69d784-9580-4fd5-b64a-9f8685f7f719" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.607889] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bd69d784-9580-4fd5-b64a-9f8685f7f719" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.608450] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bd69d784-9580-4fd5-b64a-9f8685f7f719" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.608450] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd69d784-9580-4fd5-b64a-9f8685f7f719',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.105824] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-2dfa1026-01a5-4176-a643-8ab1ceda5ce6 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.105824] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2dfa1026-01a5-4176-a643-8ab1ceda5ce6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.107919] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2dfa1026-01a5-4176-a643-8ab1ceda5ce6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.112050] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bd69d784-9580-4fd5-b64a-9f8685f7f719 with status ACTIVE [ 1019.112313] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.112477] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.112549] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.112734] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.112809] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.112991] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.113139] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.113199] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.113505] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.113505] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.113672] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.113765] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.113820] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.113966] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.114245] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.114347] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bd69d784-9580-4fd5-b64a-9f8685f7f719 is going to be updated. [ 1019.141618] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.141758] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.142454] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.142454] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.142454] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.142454] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bd69d784-9580-4fd5-b64a-9f8685f7f719" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.281433] env[70392]: INFO networking_nsxv3.common.synchronization [req-5394cf04-4ae0-4ad5-9fd8-b9d3b3fdbb3c req-ea3364aa-0448-44f6-bcaa-4531397e61ea tempest-ListServerFiltersTestJSON-50551211 tempest-ListServerFiltersTestJSON-50551211-project-member] Enqueued Resource ID: 4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 with Priority: HIGHEST for action security_group_members [ 1019.281433] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 with Priority: HIGHEST for action security_group_members [ 1019.281433] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.281433] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.281433] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.281826] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.282185] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.282456] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.282666] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.282959] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.283168] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.283367] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f7f8865-743f-4e67-8bf2-9a21ed1eaac4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.611586] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2dfa1026-01a5-4176-a643-8ab1ceda5ce6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.708724] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 43327972-df6d-4e69-b782-fda3a340af0a in Status: SUCCESS [ 1019.708724] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-43327972-df6d-4e69-b782-fda3a340af0a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.786624] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.786823] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.786916] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.787925] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.787925] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.787925] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.787925] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.787925] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.788221] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.788221] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.788355] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 already deleted. [ 1019.788458] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.867240] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 in Status: SUCCESS [ 1019.867537] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.867739] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.868036] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.868276] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.868431] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.868532] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.868730] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.868847] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.868973] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.869340] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b60d7eaa-9583-4c75-97fa-4049c63576b6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.887593] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-184 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.887796] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-184" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.888879] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-184" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.889151] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-184" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.889455] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.889661] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.889884] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.894022] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.894022] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.894022] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1019.894022] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1019.894022] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1019.894022] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1019.894022] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1019.894022] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1019.894022] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1019.918414] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1019.918628] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1019.918779] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1019.919028] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-184" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.919360] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-baa8c106-8e02-4e9a-8b1a-c29aa1ab2068 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.919580] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-baa8c106-8e02-4e9a-8b1a-c29aa1ab2068" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.919707] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-baa8c106-8e02-4e9a-8b1a-c29aa1ab2068" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.920067] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-baa8c106-8e02-4e9a-8b1a-c29aa1ab2068" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.920243] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('baa8c106-8e02-4e9a-8b1a-c29aa1ab2068',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.098549] env[70392]: INFO networking_nsxv3.common.synchronization [req-cdd937dc-1f56-4312-9cfa-ecddd3d9ada8 req-f261963f-1c93-4ad2-a246-a3a5bdaa13ac tempest-ImagesOneServerNegativeTestJSON-1691594958 tempest-ImagesOneServerNegativeTestJSON-1691594958-project-member] Enqueued Resource ID: dbeb3b19-0a8e-4685-84e0-239c82418063 with Priority: HIGHEST for action security_group_members [ 1020.099244] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbeb3b19-0a8e-4685-84e0-239c82418063 with Priority: HIGHEST for action security_group_members [ 1020.100497] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbeb3b19-0a8e-4685-84e0-239c82418063 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.100497] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.100497] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.100835] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.101089] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.101252] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.102432] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.102996] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.102996] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.103175] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbeb3b19-0a8e-4685-84e0-239c82418063',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.113566] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.113786] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.113786] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.114048] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.114182] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.114285] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2dfa1026-01a5-4176-a643-8ab1ceda5ce6 is going to be created. [ 1020.146516] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.146911] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.146911] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.147021] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.147187] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.163095] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2dfa1026-01a5-4176-a643-8ab1ceda5ce6 in Status: UNINITIALIZED for 2s [ 1020.372447] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60d7eaa-9583-4c75-97fa-4049c63576b6 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.372624] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.372658] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.373019] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.373263] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.373605] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.373685] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.373860] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.374013] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.374124] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.374412] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60d7eaa-9583-4c75-97fa-4049c63576b6 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.374496] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.374545] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.374680] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.374826] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.374921] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.374975] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.375495] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.375615] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.375681] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.375755] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b60d7eaa-9583-4c75-97fa-4049c63576b6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.425087] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.425087] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.425087] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.425087] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.425087] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.425416] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port baa8c106-8e02-4e9a-8b1a-c29aa1ab2068 not found, creating... [ 1020.425533] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.425766] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.425826] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.426411] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.426411] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.426580] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.426694] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.426815] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.427485] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.427485] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.427485] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: baa8c106-8e02-4e9a-8b1a-c29aa1ab2068 is going to be created. [ 1020.453092] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.453338] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.453500] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.453901] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.454097] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.454340] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-baa8c106-8e02-4e9a-8b1a-c29aa1ab2068" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.606102] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.606317] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.606393] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.606698] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.606808] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.607183] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.607785] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.607785] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.607785] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.607785] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.607964] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbeb3b19-0a8e-4685-84e0-239c82418063 is going to be updated. [ 1020.656034] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.656034] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.656034] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.656034] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.656034] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.668858] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbeb3b19-0a8e-4685-84e0-239c82418063 in Status: IN_PROGRESS for 2s [ 1020.879871] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b60d7eaa-9583-4c75-97fa-4049c63576b6: rpc.has_security_group_logging(os_id): False [ 1020.903868] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.903868] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.903868] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.903868] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.903868] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.903868] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.903868] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.903868] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.903868] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.903868] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.903868] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.903868] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.903868] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.905030] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.905189] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.905492] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.905650] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.905748] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.905941] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.906059] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.906173] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 is going to be updated. [ 1020.996694] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.996947] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.000418] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.000418] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.000418] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.013292] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 in Status: IN_PROGRESS for 2s [ 1021.055273] env[70392]: INFO networking_nsxv3.common.synchronization [req-b10104e0-943e-4ae4-ad55-42f1129b813e req-57528092-bb94-47e3-b833-28eea780e805 tempest-ListImageFiltersTestJSON-1434659708 tempest-ListImageFiltersTestJSON-1434659708-project-member] Enqueued Resource ID: 49e97029-e971-47d3-aa73-0fe54ba5d0b0 with Priority: HIGHEST for action security_group_members [ 1021.055742] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49e97029-e971-47d3-aa73-0fe54ba5d0b0 with Priority: HIGHEST for action security_group_members [ 1021.060228] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-49e97029-e971-47d3-aa73-0fe54ba5d0b0 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.060228] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49e97029-e971-47d3-aa73-0fe54ba5d0b0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.060228] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49e97029-e971-47d3-aa73-0fe54ba5d0b0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.060228] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49e97029-e971-47d3-aa73-0fe54ba5d0b0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.060228] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.060228] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.060228] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.060675] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.060914] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.060914] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49e97029-e971-47d3-aa73-0fe54ba5d0b0',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.350339] env[70392]: INFO networking_nsxv3.common.synchronization [req-5394cf04-4ae0-4ad5-9fd8-b9d3b3fdbb3c req-ca19cae4-ac10-42d3-a1c6-3cf64a8d7c4d service nova] Enqueued Resource ID: 4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 with Priority: HIGHEST for action security_group_rules [ 1021.350598] env[70392]: INFO networking_nsxv3.common.synchronization [req-5394cf04-4ae0-4ad5-9fd8-b9d3b3fdbb3c req-ca19cae4-ac10-42d3-a1c6-3cf64a8d7c4d service nova] Enqueued Resource ID: 4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 with Priority: HIGHEST for action security_group_members [ 1021.350777] env[70392]: INFO networking_nsxv3.common.synchronization [req-5394cf04-4ae0-4ad5-9fd8-b9d3b3fdbb3c req-ca19cae4-ac10-42d3-a1c6-3cf64a8d7c4d service nova] Enqueued Resource ID: baa8c106-8e02-4e9a-8b1a-c29aa1ab2068 with Priority: HIGHEST for action port [ 1021.351492] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 with Priority: HIGHEST for action security_group_rules [ 1021.351698] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 with Priority: HIGHEST for action security_group_members [ 1021.351853] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: baa8c106-8e02-4e9a-8b1a-c29aa1ab2068 with Priority: HIGHEST for action port [ 1021.352073] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.352272] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.352272] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.352537] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.352641] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4f7f8865-743f-4e67-8bf2-9a21ed1eaac4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.353998] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.354122] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.354208] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.354370] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.354504] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.354612] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.354724] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.354829] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.354915] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.355015] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f7f8865-743f-4e67-8bf2-9a21ed1eaac4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.359728] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-baa8c106-8e02-4e9a-8b1a-c29aa1ab2068 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.359874] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-baa8c106-8e02-4e9a-8b1a-c29aa1ab2068" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.359925] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-baa8c106-8e02-4e9a-8b1a-c29aa1ab2068" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.360165] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-baa8c106-8e02-4e9a-8b1a-c29aa1ab2068" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.360248] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('baa8c106-8e02-4e9a-8b1a-c29aa1ab2068',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.562994] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('49e97029-e971-47d3-aa73-0fe54ba5d0b0',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.862870] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.863188] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.863390] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4f7f8865-743f-4e67-8bf2-9a21ed1eaac4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.865249] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port baa8c106-8e02-4e9a-8b1a-c29aa1ab2068 with status ACTIVE [ 1021.865249] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.868019] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.868019] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.868019] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.868019] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.868019] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.868019] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.868019] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.868019] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.868019] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.868019] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.868019] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.868019] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.868019] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.868019] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.868019] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: baa8c106-8e02-4e9a-8b1a-c29aa1ab2068 is going to be updated. [ 1021.901119] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.901326] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.901434] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.901718] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.902765] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.902765] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-baa8c106-8e02-4e9a-8b1a-c29aa1ab2068" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.068216] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('49e97029-e971-47d3-aa73-0fe54ba5d0b0',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.172784] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2dfa1026-01a5-4176-a643-8ab1ceda5ce6 in Status: SUCCESS [ 1022.173047] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2dfa1026-01a5-4176-a643-8ab1ceda5ce6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.173233] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2dfa1026-01a5-4176-a643-8ab1ceda5ce6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.173485] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2dfa1026-01a5-4176-a643-8ab1ceda5ce6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.173723] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.173851] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.173915] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.174120] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.174225] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.174313] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2dfa1026-01a5-4176-a643-8ab1ceda5ce6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.174408] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2dfa1026-01a5-4176-a643-8ab1ceda5ce6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.299209] env[70392]: INFO networking_nsxv3.common.synchronization [req-e6092824-f5fd-475d-a264-5c348e1b29c3 req-52abef3c-e91c-4c3a-b8f7-37b55e154f0a tempest-ListServerFiltersTestJSON-50551211 tempest-ListServerFiltersTestJSON-50551211-project-member] Enqueued Resource ID: 4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 with Priority: HIGHEST for action security_group_members [ 1022.299209] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 with Priority: HIGHEST for action security_group_members [ 1022.299209] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.299458] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.365883] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4f7f8865-743f-4e67-8bf2-9a21ed1eaac4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.570947] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.572520] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.572733] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.574628] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.576489] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.576489] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49e97029-e971-47d3-aa73-0fe54ba5d0b0 is going to be updated. [ 1022.606239] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.606571] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.606805] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.607114] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.607346] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.618133] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49e97029-e971-47d3-aa73-0fe54ba5d0b0 in Status: IN_PROGRESS for 2s [ 1022.678898] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2dfa1026-01a5-4176-a643-8ab1ceda5ce6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.678898] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbeb3b19-0a8e-4685-84e0-239c82418063 in Status: SUCCESS [ 1022.678898] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbeb3b19-0a8e-4685-84e0-239c82418063 deletion is rescheduled due to dependency. [ 1022.678898] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.793548] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-184 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.793867] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-184" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.794212] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-184" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.794751] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-184" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.795275] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.795524] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.795704] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.796088] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.796308] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.796626] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1022.797351] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1022.797590] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1022.797786] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1022.797958] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1022.798134] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1022.798331] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1022.819358] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1022.819461] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1022.820290] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1022.820290] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-184" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.820290] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-5384ea8d-7432-40b6-b2c7-bfc818ecd8bb taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.820470] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-5384ea8d-7432-40b6-b2c7-bfc818ecd8bb" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.820470] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-5384ea8d-7432-40b6-b2c7-bfc818ecd8bb" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.820767] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-5384ea8d-7432-40b6-b2c7-bfc818ecd8bb" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.820910] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5384ea8d-7432-40b6-b2c7-bfc818ecd8bb',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.872588] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.873064] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.873064] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.873064] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.873313] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.873313] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 is going to be created. [ 1022.901971] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.903316] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.903316] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.903316] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.903316] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.918892] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 in Status: UNINITIALIZED for 2s [ 1023.031878] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 in Status: SUCCESS [ 1023.031878] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.180962] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2dfa1026-01a5-4176-a643-8ab1ceda5ce6: rpc.has_security_group_logging(os_id): False [ 1023.226507] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.226683] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.226811] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.226922] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.227015] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.227280] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.227383] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.227435] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.227593] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.227665] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.227751] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2dfa1026-01a5-4176-a643-8ab1ceda5ce6 is going to be created. [ 1023.328026] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.328026] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.328026] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.328026] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.328026] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.328026] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 5384ea8d-7432-40b6-b2c7-bfc818ecd8bb not found, creating... [ 1023.328026] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.328026] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.328026] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.328026] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.328026] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.328822] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.329082] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.329421] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.329784] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.330055] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.330315] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 5384ea8d-7432-40b6-b2c7-bfc818ecd8bb is going to be created. [ 1023.347030] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.347030] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.347030] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.347030] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.347030] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.361181] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.361181] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.361181] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.361547] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.361719] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.361984] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-5384ea8d-7432-40b6-b2c7-bfc818ecd8bb" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.380745] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2dfa1026-01a5-4176-a643-8ab1ceda5ce6 in Status: IN_PROGRESS for 2s [ 1024.129271] env[70392]: INFO networking_nsxv3.common.synchronization [req-e6092824-f5fd-475d-a264-5c348e1b29c3 req-5f853fbe-c6ba-4bdf-bceb-1536243ecc6e service nova] Enqueued Resource ID: 4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 with Priority: HIGHEST for action security_group_rules [ 1024.129271] env[70392]: INFO networking_nsxv3.common.synchronization [req-e6092824-f5fd-475d-a264-5c348e1b29c3 req-5f853fbe-c6ba-4bdf-bceb-1536243ecc6e service nova] Enqueued Resource ID: 4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 with Priority: HIGHEST for action security_group_members [ 1024.129271] env[70392]: INFO networking_nsxv3.common.synchronization [req-e6092824-f5fd-475d-a264-5c348e1b29c3 req-5f853fbe-c6ba-4bdf-bceb-1536243ecc6e service nova] Enqueued Resource ID: 5384ea8d-7432-40b6-b2c7-bfc818ecd8bb with Priority: HIGHEST for action port [ 1024.129271] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 with Priority: HIGHEST for action security_group_rules [ 1024.129271] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 with Priority: HIGHEST for action security_group_members [ 1024.129271] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5384ea8d-7432-40b6-b2c7-bfc818ecd8bb with Priority: HIGHEST for action port [ 1024.129271] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.130029] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.130426] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.130752] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.131071] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-5384ea8d-7432-40b6-b2c7-bfc818ecd8bb taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.132043] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5384ea8d-7432-40b6-b2c7-bfc818ecd8bb" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.132043] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5384ea8d-7432-40b6-b2c7-bfc818ecd8bb" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.132043] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5384ea8d-7432-40b6-b2c7-bfc818ecd8bb" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.132043] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5384ea8d-7432-40b6-b2c7-bfc818ecd8bb',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.627885] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49e97029-e971-47d3-aa73-0fe54ba5d0b0 in Status: SUCCESS [ 1024.628201] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49e97029-e971-47d3-aa73-0fe54ba5d0b0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.634707] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5384ea8d-7432-40b6-b2c7-bfc818ecd8bb with status ACTIVE [ 1024.634913] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.635118] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.635198] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.635414] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.635494] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.635679] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.635779] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.635851] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.636041] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.636146] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.636305] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.636398] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.636465] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.636596] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.636669] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.636753] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5384ea8d-7432-40b6-b2c7-bfc818ecd8bb is going to be updated. [ 1024.657276] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.657407] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.657486] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.657753] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.658366] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.658366] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5384ea8d-7432-40b6-b2c7-bfc818ecd8bb" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.928998] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 in Status: SUCCESS [ 1024.929293] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.929657] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.929657] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.929845] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.929956] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.930055] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.930183] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.930286] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.930456] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.930556] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4f7f8865-743f-4e67-8bf2-9a21ed1eaac4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.931449] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.932061] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.932061] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.932061] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.932061] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.932061] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.932463] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.932463] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f7f8865-743f-4e67-8bf2-9a21ed1eaac4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.396504] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2dfa1026-01a5-4176-a643-8ab1ceda5ce6 in Status: SUCCESS [ 1025.396504] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2dfa1026-01a5-4176-a643-8ab1ceda5ce6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.434877] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.434877] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.435109] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4f7f8865-743f-4e67-8bf2-9a21ed1eaac4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.831088] env[70392]: INFO networking_nsxv3.common.synchronization [req-cae2d90d-2aaf-4109-bba7-19820ed48a6f req-a7079a1e-d38e-445b-a829-9d397fb675b7 tempest-ListServerFiltersTestJSON-50551211 tempest-ListServerFiltersTestJSON-50551211-project-member] Enqueued Resource ID: 4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 with Priority: HIGHEST for action security_group_members [ 1025.832206] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 with Priority: HIGHEST for action security_group_members [ 1025.832752] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.832951] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.938768] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4f7f8865-743f-4e67-8bf2-9a21ed1eaac4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.208166] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-184 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.208362] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-184" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.208489] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-184" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.208822] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-184" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.209655] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.209655] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.209655] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.209918] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.211302] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.211648] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1026.211808] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1026.212046] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1026.212126] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1026.212340] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1026.212458] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1026.212625] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1026.231687] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1026.231879] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1026.232049] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1026.232271] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-184" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.232593] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-f1ccdb04-b942-4a31-a346-0952d8a466e6 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.232773] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-f1ccdb04-b942-4a31-a346-0952d8a466e6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.232897] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-f1ccdb04-b942-4a31-a346-0952d8a466e6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.233271] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-f1ccdb04-b942-4a31-a346-0952d8a466e6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.233418] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1ccdb04-b942-4a31-a346-0952d8a466e6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.441208] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.441517] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.441517] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.441746] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.441907] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.442849] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 is going to be updated. [ 1026.471335] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.471480] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.471616] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.471849] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.472090] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.487346] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 in Status: IN_PROGRESS for 2s [ 1026.736247] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.736484] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.736623] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.736933] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.737169] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.737390] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port f1ccdb04-b942-4a31-a346-0952d8a466e6 not found, creating... [ 1026.737709] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.737912] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.738103] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.738387] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.738581] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.742022] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.742022] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.742022] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.742022] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.742022] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.742022] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: f1ccdb04-b942-4a31-a346-0952d8a466e6 is going to be created. [ 1026.765551] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.765768] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.765895] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.766205] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.766481] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.767660] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-f1ccdb04-b942-4a31-a346-0952d8a466e6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.535764] env[70392]: INFO networking_nsxv3.common.synchronization [req-cae2d90d-2aaf-4109-bba7-19820ed48a6f req-4408afd1-081f-4c10-b4f1-99c7c840f41c service nova] Enqueued Resource ID: 4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 with Priority: HIGHEST for action security_group_rules [ 1027.536093] env[70392]: INFO networking_nsxv3.common.synchronization [req-cae2d90d-2aaf-4109-bba7-19820ed48a6f req-4408afd1-081f-4c10-b4f1-99c7c840f41c service nova] Enqueued Resource ID: 4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 with Priority: HIGHEST for action security_group_members [ 1027.536178] env[70392]: INFO networking_nsxv3.common.synchronization [req-cae2d90d-2aaf-4109-bba7-19820ed48a6f req-4408afd1-081f-4c10-b4f1-99c7c840f41c service nova] Enqueued Resource ID: f1ccdb04-b942-4a31-a346-0952d8a466e6 with Priority: HIGHEST for action port [ 1027.536424] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 with Priority: HIGHEST for action security_group_rules [ 1027.536553] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 with Priority: HIGHEST for action security_group_members [ 1027.536655] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1ccdb04-b942-4a31-a346-0952d8a466e6 with Priority: HIGHEST for action port [ 1027.537418] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.537595] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.537856] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.537991] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.538235] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-f1ccdb04-b942-4a31-a346-0952d8a466e6 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.538380] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f1ccdb04-b942-4a31-a346-0952d8a466e6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.538477] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f1ccdb04-b942-4a31-a346-0952d8a466e6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.539094] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f1ccdb04-b942-4a31-a346-0952d8a466e6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.539094] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1ccdb04-b942-4a31-a346-0952d8a466e6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.044270] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f1ccdb04-b942-4a31-a346-0952d8a466e6 with status ACTIVE [ 1028.044270] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.044270] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.044270] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.044270] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.044270] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.044270] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.044270] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.044270] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.044270] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.044270] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.044270] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.044270] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.044270] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.044270] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.044270] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.044270] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f1ccdb04-b942-4a31-a346-0952d8a466e6 is going to be updated. [ 1028.076968] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.076968] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.076968] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.076968] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.076968] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.076968] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f1ccdb04-b942-4a31-a346-0952d8a466e6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.499213] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 in Status: SUCCESS [ 1028.499442] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.499706] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.499871] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.500121] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.500214] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.500296] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.500433] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.500511] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.500592] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f7f8865-743f-4e67-8bf2-9a21ed1eaac4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.002921] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4f7f8865-743f-4e67-8bf2-9a21ed1eaac4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.505527] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4f7f8865-743f-4e67-8bf2-9a21ed1eaac4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.008085] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.008353] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.008353] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.008531] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.008622] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.008723] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 is going to be updated. [ 1030.037914] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.038072] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.038169] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.038398] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.038557] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.050532] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 in Status: IN_PROGRESS for 2s [ 1032.064704] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 in Status: SUCCESS [ 1032.069023] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.069023] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.069023] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.069023] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.069023] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.069023] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.069023] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.069023] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.069023] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.069023] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.069023] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.069023] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.069023] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.073025] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.073025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.073025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.073025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.073025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.073025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.073025] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4f7f8865-743f-4e67-8bf2-9a21ed1eaac4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.073025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.073025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.073025] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.073025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.073025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.073025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.073025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.073025] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f7f8865-743f-4e67-8bf2-9a21ed1eaac4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.538276] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1032.538276] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=5 [ 1032.575838] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4f7f8865-743f-4e67-8bf2-9a21ed1eaac4: rpc.has_security_group_logging(os_id): False [ 1032.577169] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4f7f8865-743f-4e67-8bf2-9a21ed1eaac4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.601214] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.604067] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.604067] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.604067] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.604067] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.604067] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.604067] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.604067] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.604067] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.604067] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.604067] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.604067] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.604067] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.604067] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.604067] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.604634] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.604634] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.604634] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.604634] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.604634] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.604830] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 is going to be created. [ 1032.663206] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.663523] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.663647] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.663981] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.664232] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.676408] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 in Status: IN_PROGRESS for 2s [ 1033.080157] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4f7f8865-743f-4e67-8bf2-9a21ed1eaac4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.135826] env[70392]: INFO networking_nsxv3.common.synchronization [None req-0441c156-420c-4539-95c7-d2c58e0bbfc2 None None] Enqueued Resource ID: b905678d-b89f-401b-8ec7-556c4c47a12b with Priority: HIGHEST for action port [ 1033.136111] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b905678d-b89f-401b-8ec7-556c4c47a12b with Priority: HIGHEST for action port [ 1033.137566] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-b905678d-b89f-401b-8ec7-556c4c47a12b taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.137566] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b905678d-b89f-401b-8ec7-556c4c47a12b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.137566] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b905678d-b89f-401b-8ec7-556c4c47a12b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.137566] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b905678d-b89f-401b-8ec7-556c4c47a12b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.137925] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b905678d-b89f-401b-8ec7-556c4c47a12b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.443345] env[70392]: INFO networking_nsxv3.common.synchronization [req-34791f57-a91c-41b4-b9be-4656627ab5d6 req-3061b01b-fec9-411f-901e-f9af81f7e21a tempest-SecurityGroupsTestJSON-87195518 tempest-SecurityGroupsTestJSON-87195518-project-member] Enqueued Resource ID: 438fa731-ac4f-4636-ae4b-8e30973002cd with Priority: HIGHEST for action security_group_members [ 1033.443345] env[70392]: INFO networking_nsxv3.common.synchronization [req-34791f57-a91c-41b4-b9be-4656627ab5d6 req-3061b01b-fec9-411f-901e-f9af81f7e21a tempest-SecurityGroupsTestJSON-87195518 tempest-SecurityGroupsTestJSON-87195518-project-member] Enqueued Resource ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b with Priority: HIGHEST for action security_group_members [ 1033.443345] env[70392]: INFO networking_nsxv3.common.synchronization [req-34791f57-a91c-41b4-b9be-4656627ab5d6 req-3061b01b-fec9-411f-901e-f9af81f7e21a tempest-SecurityGroupsTestJSON-87195518 tempest-SecurityGroupsTestJSON-87195518-project-member] Enqueued Resource ID: fc6010b2-a356-4e5d-898a-bf9ca32456ec with Priority: HIGHEST for action security_group_members [ 1033.443345] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 438fa731-ac4f-4636-ae4b-8e30973002cd with Priority: HIGHEST for action security_group_members [ 1033.443345] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b with Priority: HIGHEST for action security_group_members [ 1033.443528] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc6010b2-a356-4e5d-898a-bf9ca32456ec with Priority: HIGHEST for action security_group_members [ 1033.443676] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-438fa731-ac4f-4636-ae4b-8e30973002cd taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.443827] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-438fa731-ac4f-4636-ae4b-8e30973002cd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.443928] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-438fa731-ac4f-4636-ae4b-8e30973002cd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.447565] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-438fa731-ac4f-4636-ae4b-8e30973002cd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.447565] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.447565] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.447565] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.447565] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.447831] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.447831] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('438fa731-ac4f-4636-ae4b-8e30973002cd',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.450929] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.452328] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.452414] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.453423] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.453423] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.453423] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.453423] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.453423] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.453423] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.453928] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.455223] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc6010b2-a356-4e5d-898a-bf9ca32456ec taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.456953] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc6010b2-a356-4e5d-898a-bf9ca32456ec" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.456953] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc6010b2-a356-4e5d-898a-bf9ca32456ec" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.456953] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc6010b2-a356-4e5d-898a-bf9ca32456ec" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.456953] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.456953] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.456953] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.456953] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.457289] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.457289] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc6010b2-a356-4e5d-898a-bf9ca32456ec',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.583152] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.583306] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.583375] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.583601] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.583736] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.583951] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 is going to be updated. [ 1033.615408] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.615504] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.615565] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.615922] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.616069] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.629021] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 in Status: IN_PROGRESS for 2s [ 1033.640523] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b905678d-b89f-401b-8ec7-556c4c47a12b [ 1033.640729] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.640860] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.640932] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.641173] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.641255] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.641355] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b905678d-b89f-401b-8ec7-556c4c47a12b already deleted. [ 1033.641439] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b905678d-b89f-401b-8ec7-556c4c47a12b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.959385] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.959385] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.959385] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.959385] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.959385] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.959385] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.959385] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.959385] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.959385] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.959385] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.959385] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b is going to be updated. [ 1033.959787] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.959787] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.959787] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.959787] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.961360] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.961477] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.991822] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.992166] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.992298] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.992390] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.992582] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.992683] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.992779] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 438fa731-ac4f-4636-ae4b-8e30973002cd is going to be updated. [ 1033.993899] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.994126] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.995959] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.996239] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.996239] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.996450] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.996506] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.018573] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b in Status: IN_PROGRESS for 2s [ 1034.022107] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.022365] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.022483] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.022552] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.022751] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.022839] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.022932] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc6010b2-a356-4e5d-898a-bf9ca32456ec is going to be updated. [ 1034.040281] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.040435] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.040507] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.040718] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.040860] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.060452] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.060688] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.060688] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.060893] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.061057] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.071868] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc6010b2-a356-4e5d-898a-bf9ca32456ec in Status: IN_PROGRESS for 2s [ 1034.072961] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 438fa731-ac4f-4636-ae4b-8e30973002cd in Status: IN_PROGRESS for 2s [ 1034.231769] env[70392]: INFO networking_nsxv3.common.synchronization [None req-f77424f5-d1d8-4883-b2ac-a5878505a949 tempest-AttachVolumeShelveTestJSON-1019030511 tempest-AttachVolumeShelveTestJSON-1019030511-project-member] Enqueued Resource ID: ee8b641c-b2f7-4b94-85bb-98a31dba1604 with Priority: HIGHEST for action security_group_rules [ 1034.232436] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee8b641c-b2f7-4b94-85bb-98a31dba1604 with Priority: HIGHEST for action security_group_rules [ 1034.232750] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee8b641c-b2f7-4b94-85bb-98a31dba1604 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.234944] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee8b641c-b2f7-4b94-85bb-98a31dba1604" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.235095] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee8b641c-b2f7-4b94-85bb-98a31dba1604" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.235464] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee8b641c-b2f7-4b94-85bb-98a31dba1604" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.235611] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee8b641c-b2f7-4b94-85bb-98a31dba1604',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.387671] env[70392]: INFO networking_nsxv3.common.synchronization [None req-fb5649b3-368b-4167-af1d-f0da79050f26 tempest-AttachVolumeShelveTestJSON-1019030511 tempest-AttachVolumeShelveTestJSON-1019030511-project-member] Enqueued Resource ID: ee8b641c-b2f7-4b94-85bb-98a31dba1604 with Priority: HIGHEST for action security_group_rules [ 1034.388525] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee8b641c-b2f7-4b94-85bb-98a31dba1604 with Priority: HIGHEST for action security_group_rules [ 1034.388929] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee8b641c-b2f7-4b94-85bb-98a31dba1604 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.389036] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee8b641c-b2f7-4b94-85bb-98a31dba1604" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.702798] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 in Status: SUCCESS [ 1034.703070] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.703250] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.703463] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.703548] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4f7f8865-743f-4e67-8bf2-9a21ed1eaac4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.760295] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.761279] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.761385] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.761665] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.761815] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.761935] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee8b641c-b2f7-4b94-85bb-98a31dba1604 already deleted. [ 1034.762047] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee8b641c-b2f7-4b94-85bb-98a31dba1604" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.762241] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee8b641c-b2f7-4b94-85bb-98a31dba1604" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.762430] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee8b641c-b2f7-4b94-85bb-98a31dba1604" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.762537] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee8b641c-b2f7-4b94-85bb-98a31dba1604',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.068385] env[70392]: INFO networking_nsxv3.common.synchronization [None req-d2902670-ead1-48ef-87e0-d423b4d9092c None None] Enqueued Resource ID: 68bfc75a-8cb9-47a1-b0cd-8884906fcbcf with Priority: HIGHEST for action port [ 1035.068480] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68bfc75a-8cb9-47a1-b0cd-8884906fcbcf with Priority: HIGHEST for action port [ 1035.069408] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-68bfc75a-8cb9-47a1-b0cd-8884906fcbcf taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.069545] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-68bfc75a-8cb9-47a1-b0cd-8884906fcbcf" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.069633] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-68bfc75a-8cb9-47a1-b0cd-8884906fcbcf" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.069946] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-68bfc75a-8cb9-47a1-b0cd-8884906fcbcf" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.070311] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68bfc75a-8cb9-47a1-b0cd-8884906fcbcf',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.206250] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.206250] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.287747] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.288137] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.288137] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.288137] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.288240] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.288395] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee8b641c-b2f7-4b94-85bb-98a31dba1604 already deleted. [ 1035.288468] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee8b641c-b2f7-4b94-85bb-98a31dba1604" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.334383] env[70392]: INFO networking_nsxv3.common.synchronization [req-8ae49d13-3c93-4d12-a003-6dd0d1205017 req-bcd7dfe8-8fb0-452d-ba29-d085205141a3 tempest-MigrationsAdminTest-1525374997 tempest-MigrationsAdminTest-1525374997-project-member] Enqueued Resource ID: 5fec7002-3137-40f1-a653-f520126396a2 with Priority: HIGHEST for action security_group_members [ 1035.338022] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fec7002-3137-40f1-a653-f520126396a2 with Priority: HIGHEST for action security_group_members [ 1035.338022] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fec7002-3137-40f1-a653-f520126396a2 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.338022] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.338022] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.338022] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.338022] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.338022] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.338022] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.338022] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.338022] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.338022] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5fec7002-3137-40f1-a653-f520126396a2',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.571721] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 68bfc75a-8cb9-47a1-b0cd-8884906fcbcf [ 1035.572067] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.572395] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.572527] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.572962] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.573071] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.573176] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:68bfc75a-8cb9-47a1-b0cd-8884906fcbcf already deleted. [ 1035.573265] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-68bfc75a-8cb9-47a1-b0cd-8884906fcbcf" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.641469] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 in Status: SUCCESS [ 1035.641835] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.641979] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.642268] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.642436] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.642555] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.642622] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.642947] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.642947] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.642947] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f7f8865-743f-4e67-8bf2-9a21ed1eaac4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.840486] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.840486] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.840793] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.841687] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.866912] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.867210] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.867356] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.867532] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.867712] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.867774] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.867808] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5fec7002-3137-40f1-a653-f520126396a2 is going to be updated. [ 1035.903022] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.903022] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.903022] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.903022] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.903022] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.916234] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5fec7002-3137-40f1-a653-f520126396a2 in Status: IN_PROGRESS for 2s [ 1036.028041] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b in Status: SUCCESS [ 1036.028236] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b deletion is rescheduled due to dependency. [ 1036.028355] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.083018] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 438fa731-ac4f-4636-ae4b-8e30973002cd in Status: SUCCESS [ 1036.083254] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 438fa731-ac4f-4636-ae4b-8e30973002cd deletion is rescheduled due to dependency. [ 1036.083421] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-438fa731-ac4f-4636-ae4b-8e30973002cd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.084451] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc6010b2-a356-4e5d-898a-bf9ca32456ec in Status: SUCCESS [ 1036.084451] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc6010b2-a356-4e5d-898a-bf9ca32456ec deletion is rescheduled due to dependency. [ 1036.084451] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc6010b2-a356-4e5d-898a-bf9ca32456ec" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.144751] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4f7f8865-743f-4e67-8bf2-9a21ed1eaac4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.648169] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4f7f8865-743f-4e67-8bf2-9a21ed1eaac4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.152026] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.152026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.152026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.152249] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.152249] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.152325] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 is going to be updated. [ 1037.184533] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.184771] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.184871] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.185533] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.185533] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.196196] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 in Status: IN_PROGRESS for 2s [ 1037.927502] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5fec7002-3137-40f1-a653-f520126396a2 in Status: SUCCESS [ 1037.927785] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5fec7002-3137-40f1-a653-f520126396a2 deletion is rescheduled due to dependency. [ 1037.927885] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.706731] env[70392]: INFO networking_nsxv3.common.synchronization [req-672d6902-4c67-4869-956b-c4fa3d3bb612 req-b53e768e-da41-4a35-a790-ad3118944c4c tempest-ServersAdminTestJSON-721710769 tempest-ServersAdminTestJSON-721710769-project-member] Enqueued Resource ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 with Priority: HIGHEST for action security_group_members [ 1038.707294] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 with Priority: HIGHEST for action security_group_members [ 1038.707655] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-f54639a3-c11e-4833-b47a-e0b477c46dd5 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.708069] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.708069] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.708069] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.708277] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.708277] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.708405] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.708512] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.708570] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.709632] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f54639a3-c11e-4833-b47a-e0b477c46dd5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.207684] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 in Status: SUCCESS [ 1039.208035] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.208140] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.208331] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.208517] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.208641] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.209594] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.209594] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.209594] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.209594] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.209594] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4f7f8865-743f-4e67-8bf2-9a21ed1eaac4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.211881] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f54639a3-c11e-4833-b47a-e0b477c46dd5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.487227] env[70392]: INFO networking_nsxv3.common.synchronization [req-62311c4f-72f4-4aa0-849d-b516ce585c27 req-38b337a2-7897-40b4-b0e6-af0713838fe6 tempest-ImagesTestJSON-499820929 tempest-ImagesTestJSON-499820929-project-member] Enqueued Resource ID: bca01ddc-73d5-4856-bbff-aefad642492a with Priority: HIGHEST for action security_group_members [ 1039.487798] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bca01ddc-73d5-4856-bbff-aefad642492a with Priority: HIGHEST for action security_group_members [ 1039.488182] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-bca01ddc-73d5-4856-bbff-aefad642492a taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.488395] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.488465] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.488960] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.489194] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.489427] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.489554] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.489774] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.489910] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.490054] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bca01ddc-73d5-4856-bbff-aefad642492a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.714429] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.714429] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.714429] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.714633] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.714633] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.714807] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.714807] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.714919] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.715014] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.715102] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.715247] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.715334] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.715900] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.715900] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.715900] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.715900] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.715900] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.716339] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.716339] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.716339] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.716339] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4f7f8865-743f-4e67-8bf2-9a21ed1eaac4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.717907] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f54639a3-c11e-4833-b47a-e0b477c46dd5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.780760] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-153 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.783411] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-153" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.783822] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-153" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.784364] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-153" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.784826] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.785149] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.785393] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.785754] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.786039] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.786407] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1039.786685] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1039.786936] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1039.787178] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1039.787396] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1039.787599] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1039.788382] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1039.808583] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1039.808980] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1039.809349] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1039.809650] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-153" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.810208] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-12f2a488-6845-43f5-a303-9af8f42394ed taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.810560] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-12f2a488-6845-43f5-a303-9af8f42394ed" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.810786] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-12f2a488-6845-43f5-a303-9af8f42394ed" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.811190] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-12f2a488-6845-43f5-a303-9af8f42394ed" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.811434] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12f2a488-6845-43f5-a303-9af8f42394ed',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.997536] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.997715] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.997786] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.998016] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.020160] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.020434] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.020554] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.020624] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.020819] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.020902] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.020990] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bca01ddc-73d5-4856-bbff-aefad642492a is going to be updated. [ 1040.051917] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.052085] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.052201] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.052744] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.052744] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.063726] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bca01ddc-73d5-4856-bbff-aefad642492a in Status: IN_PROGRESS for 2s [ 1040.174488] env[70392]: INFO networking_nsxv3.common.synchronization [req-917fe779-8cf4-4ff0-9a04-0d5f41b20f2d req-927ff58d-a773-468e-8d07-f4de4850918b tempest-ServerActionsTestOtherA-1411478130 tempest-ServerActionsTestOtherA-1411478130-project-member] Enqueued Resource ID: f5251c5e-578a-48aa-8195-e1dc88834ad8 with Priority: HIGHEST for action security_group_members [ 1040.175431] env[70392]: INFO networking_nsxv3.common.synchronization [req-79a0779b-ed7d-4ebb-bc18-539e276bfc5b req-e63ff533-c8e7-44ae-9e3f-623d7a00de06 tempest-AttachInterfacesTestJSON-2046649887 tempest-AttachInterfacesTestJSON-2046649887-project-member] Enqueued Resource ID: 3507e503-4abd-47ec-8347-82fc9e691881 with Priority: HIGHEST for action security_group_members [ 1040.176097] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5251c5e-578a-48aa-8195-e1dc88834ad8 with Priority: HIGHEST for action security_group_members [ 1040.180016] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3507e503-4abd-47ec-8347-82fc9e691881 with Priority: HIGHEST for action security_group_members [ 1040.180016] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5251c5e-578a-48aa-8195-e1dc88834ad8 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.180016] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5251c5e-578a-48aa-8195-e1dc88834ad8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.180016] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5251c5e-578a-48aa-8195-e1dc88834ad8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.180016] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5251c5e-578a-48aa-8195-e1dc88834ad8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.180016] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.180016] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.180016] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.180016] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.180016] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.180016] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5251c5e-578a-48aa-8195-e1dc88834ad8',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.180016] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-3507e503-4abd-47ec-8347-82fc9e691881 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.180016] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.180016] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.180016] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.180016] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.180016] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.180016] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.180855] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.180855] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.180855] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3507e503-4abd-47ec-8347-82fc9e691881',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.220664] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4f7f8865-743f-4e67-8bf2-9a21ed1eaac4: rpc.has_security_group_logging(os_id): False [ 1040.223982] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.224186] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.224275] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.224570] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.224699] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.224854] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 is going to be updated. [ 1040.239735] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.239882] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.239955] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.240177] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.240268] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.240458] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.240556] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.240611] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.240756] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.240829] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.241282] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.241454] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.241663] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.243105] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.243214] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.243416] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.243516] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.243580] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.243730] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.243808] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.243967] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 is going to be updated. [ 1040.257193] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.257482] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.257482] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.257631] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.257702] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.266025] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 in Status: IN_PROGRESS for 2s [ 1040.314862] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.314862] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.314862] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.314862] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.314862] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.316296] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.320016] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.320016] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.320016] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.320016] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.320016] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 12f2a488-6845-43f5-a303-9af8f42394ed not found, creating... [ 1040.320016] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.320016] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.320016] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.320016] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.320016] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.320525] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.320525] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.320525] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.320525] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.320525] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.320525] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 12f2a488-6845-43f5-a303-9af8f42394ed is going to be created. [ 1040.358537] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 in Status: IN_PROGRESS for 2s [ 1040.361217] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.361457] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.361557] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.361867] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.362124] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.362361] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-12f2a488-6845-43f5-a303-9af8f42394ed" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.585842] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-328 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.586103] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.586446] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.586575] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.587220] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.587220] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.587379] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.587596] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.587754] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.587974] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1040.588151] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1040.588297] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1040.588435] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1040.588577] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1040.588712] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1040.588892] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1040.608782] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1040.609018] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1040.609133] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1040.609328] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.609665] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-5d13e9eb-2cb3-4a42-8ed2-35641a39d7a2 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.609840] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-5d13e9eb-2cb3-4a42-8ed2-35641a39d7a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.609967] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-5d13e9eb-2cb3-4a42-8ed2-35641a39d7a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.610693] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-5d13e9eb-2cb3-4a42-8ed2-35641a39d7a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.610693] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d13e9eb-2cb3-4a42-8ed2-35641a39d7a2',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.682210] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.682380] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.682453] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.682660] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.682761] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.682960] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.683072] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.683134] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.683283] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.683360] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.683449] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5251c5e-578a-48aa-8195-e1dc88834ad8 is going to be updated. [ 1040.684643] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.684752] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.684819] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.685008] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.705717] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.705717] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.705717] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.705717] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.705717] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.705717] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.705717] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3507e503-4abd-47ec-8347-82fc9e691881 is going to be updated. [ 1040.715869] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.716138] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.716241] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.716521] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.716772] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.726351] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5251c5e-578a-48aa-8195-e1dc88834ad8 in Status: IN_PROGRESS for 2s [ 1040.737717] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.737865] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.737961] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.738150] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.738295] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.747241] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3507e503-4abd-47ec-8347-82fc9e691881 in Status: IN_PROGRESS for 2s [ 1041.017344] env[70392]: INFO networking_nsxv3.common.synchronization [req-62311c4f-72f4-4aa0-849d-b516ce585c27 req-01354d7c-0681-4e7f-a975-95506524788b service nova] Enqueued Resource ID: bca01ddc-73d5-4856-bbff-aefad642492a with Priority: HIGHEST for action security_group_rules [ 1041.017344] env[70392]: INFO networking_nsxv3.common.synchronization [req-62311c4f-72f4-4aa0-849d-b516ce585c27 req-01354d7c-0681-4e7f-a975-95506524788b service nova] Enqueued Resource ID: bca01ddc-73d5-4856-bbff-aefad642492a with Priority: HIGHEST for action security_group_members [ 1041.017344] env[70392]: INFO networking_nsxv3.common.synchronization [req-62311c4f-72f4-4aa0-849d-b516ce585c27 req-01354d7c-0681-4e7f-a975-95506524788b service nova] Enqueued Resource ID: 12f2a488-6845-43f5-a303-9af8f42394ed with Priority: HIGHEST for action port [ 1041.017344] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bca01ddc-73d5-4856-bbff-aefad642492a with Priority: HIGHEST for action security_group_rules [ 1041.017344] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bca01ddc-73d5-4856-bbff-aefad642492a with Priority: HIGHEST for action security_group_members [ 1041.017344] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12f2a488-6845-43f5-a303-9af8f42394ed with Priority: HIGHEST for action port [ 1041.017344] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bca01ddc-73d5-4856-bbff-aefad642492a taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.017344] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.017344] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.017344] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.017344] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bca01ddc-73d5-4856-bbff-aefad642492a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.019102] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-bca01ddc-73d5-4856-bbff-aefad642492a taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.019327] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.019649] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-12f2a488-6845-43f5-a303-9af8f42394ed taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.019898] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12f2a488-6845-43f5-a303-9af8f42394ed" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.020065] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12f2a488-6845-43f5-a303-9af8f42394ed" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.020344] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12f2a488-6845-43f5-a303-9af8f42394ed" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.020593] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12f2a488-6845-43f5-a303-9af8f42394ed',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.112880] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.113203] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.113342] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.113618] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.113769] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.113992] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 5d13e9eb-2cb3-4a42-8ed2-35641a39d7a2 not found, creating... [ 1041.114272] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.114437] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.114560] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.114784] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.114926] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.115230] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.115389] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.115510] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.115722] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.115858] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.116029] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 5d13e9eb-2cb3-4a42-8ed2-35641a39d7a2 is going to be created. [ 1041.138472] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.139015] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.139272] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.139724] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.140063] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.140401] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-5d13e9eb-2cb3-4a42-8ed2-35641a39d7a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.523228] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 12f2a488-6845-43f5-a303-9af8f42394ed with status ACTIVE [ 1041.523484] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.523638] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.523758] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.524020] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.524119] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.524318] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.524419] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.524487] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.524656] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.524741] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.525122] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.525281] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.525390] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.525604] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.525726] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.525891] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 12f2a488-6845-43f5-a303-9af8f42394ed is going to be updated. [ 1041.527500] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-bca01ddc-73d5-4856-bbff-aefad642492a taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.527500] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.550038] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.550255] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.550323] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.550538] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.550681] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.550842] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12f2a488-6845-43f5-a303-9af8f42394ed" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.906386] env[70392]: INFO networking_nsxv3.common.synchronization [req-79a0779b-ed7d-4ebb-bc18-539e276bfc5b req-fccdfb1f-3c82-475d-813e-3ce228707e6d service nova] Enqueued Resource ID: 3507e503-4abd-47ec-8347-82fc9e691881 with Priority: HIGHEST for action security_group_rules [ 1041.906581] env[70392]: INFO networking_nsxv3.common.synchronization [req-79a0779b-ed7d-4ebb-bc18-539e276bfc5b req-fccdfb1f-3c82-475d-813e-3ce228707e6d service nova] Enqueued Resource ID: 3507e503-4abd-47ec-8347-82fc9e691881 with Priority: HIGHEST for action security_group_members [ 1041.906726] env[70392]: INFO networking_nsxv3.common.synchronization [req-79a0779b-ed7d-4ebb-bc18-539e276bfc5b req-fccdfb1f-3c82-475d-813e-3ce228707e6d service nova] Enqueued Resource ID: 5d13e9eb-2cb3-4a42-8ed2-35641a39d7a2 with Priority: HIGHEST for action port [ 1041.906965] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3507e503-4abd-47ec-8347-82fc9e691881 with Priority: HIGHEST for action security_group_rules [ 1041.907107] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3507e503-4abd-47ec-8347-82fc9e691881 with Priority: HIGHEST for action security_group_members [ 1041.907202] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d13e9eb-2cb3-4a42-8ed2-35641a39d7a2 with Priority: HIGHEST for action port [ 1041.907836] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3507e503-4abd-47ec-8347-82fc9e691881 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.907931] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.908012] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.908777] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.908872] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3507e503-4abd-47ec-8347-82fc9e691881',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.913020] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-3507e503-4abd-47ec-8347-82fc9e691881 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.913020] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.913020] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-5d13e9eb-2cb3-4a42-8ed2-35641a39d7a2 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.913020] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5d13e9eb-2cb3-4a42-8ed2-35641a39d7a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.913020] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5d13e9eb-2cb3-4a42-8ed2-35641a39d7a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.913020] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5d13e9eb-2cb3-4a42-8ed2-35641a39d7a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.913020] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d13e9eb-2cb3-4a42-8ed2-35641a39d7a2',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.074253] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bca01ddc-73d5-4856-bbff-aefad642492a in Status: SUCCESS [ 1042.074440] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bca01ddc-73d5-4856-bbff-aefad642492a deletion is rescheduled due to dependency. [ 1042.074564] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.074726] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.074946] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.075182] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.075304] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.075371] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.075534] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.075616] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.075713] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bca01ddc-73d5-4856-bbff-aefad642492a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.276028] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 in Status: SUCCESS [ 1042.276313] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.373727] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 in Status: SUCCESS [ 1042.374043] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.374241] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.374667] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.374667] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4f7f8865-743f-4e67-8bf2-9a21ed1eaac4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.415244] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-3507e503-4abd-47ec-8347-82fc9e691881 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.415244] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.415244] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5d13e9eb-2cb3-4a42-8ed2-35641a39d7a2 with status ACTIVE [ 1042.415244] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.415244] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.415244] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.415244] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.415244] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.415600] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.415600] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.415600] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.415712] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.415775] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.415966] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.416062] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.416120] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.416256] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.416325] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.416428] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5d13e9eb-2cb3-4a42-8ed2-35641a39d7a2 is going to be updated. [ 1042.443835] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.444061] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.444150] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.444346] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.444484] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.444644] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5d13e9eb-2cb3-4a42-8ed2-35641a39d7a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.580844] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bca01ddc-73d5-4856-bbff-aefad642492a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.736886] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5251c5e-578a-48aa-8195-e1dc88834ad8 in Status: SUCCESS [ 1042.736886] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5251c5e-578a-48aa-8195-e1dc88834ad8 deletion is rescheduled due to dependency. [ 1042.739066] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5251c5e-578a-48aa-8195-e1dc88834ad8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.759367] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3507e503-4abd-47ec-8347-82fc9e691881 in Status: SUCCESS [ 1042.759736] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3507e503-4abd-47ec-8347-82fc9e691881 deletion is rescheduled due to dependency. [ 1042.759983] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.760294] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.760672] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.760952] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.764805] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.764805] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.764805] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.764805] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.764805] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3507e503-4abd-47ec-8347-82fc9e691881',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.877243] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.877474] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.877577] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.877828] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.878054] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.878194] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.878300] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.878516] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.878637] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.878759] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.878880] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4f7f8865-743f-4e67-8bf2-9a21ed1eaac4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.083525] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bca01ddc-73d5-4856-bbff-aefad642492a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.264525] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3507e503-4abd-47ec-8347-82fc9e691881',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.385026] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.385026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.385026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.385026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.385026] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.385026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.385026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.385026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.385026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.385026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.385026] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.385026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.385026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.385026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.385026] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.385026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.385715] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.385715] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.385715] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.385715] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.385715] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4f7f8865-743f-4e67-8bf2-9a21ed1eaac4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.588052] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.588052] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.588052] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.588052] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.588052] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.588052] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bca01ddc-73d5-4856-bbff-aefad642492a is going to be updated. [ 1043.618677] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.618817] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.618888] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.619118] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.619259] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.628532] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bca01ddc-73d5-4856-bbff-aefad642492a in Status: IN_PROGRESS for 2s [ 1043.766357] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3507e503-4abd-47ec-8347-82fc9e691881',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.886942] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4f7f8865-743f-4e67-8bf2-9a21ed1eaac4: rpc.has_security_group_logging(os_id): False [ 1043.906610] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.908975] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.908975] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.908975] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.908975] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.908975] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.908975] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.908975] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.908975] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.908975] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.908975] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.908975] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.908975] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.908975] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.908975] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.909568] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.909568] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.909568] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.909568] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.909568] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.909568] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 is going to be updated. [ 1043.973035] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.973035] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.973035] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.973035] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.973295] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.990195] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 in Status: IN_PROGRESS for 2s [ 1044.272580] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.273419] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.273523] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.273837] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.274070] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.274954] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3507e503-4abd-47ec-8347-82fc9e691881 is going to be updated. [ 1044.310934] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.310934] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.311153] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.311212] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.311372] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.321678] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3507e503-4abd-47ec-8347-82fc9e691881 in Status: IN_PROGRESS for 2s [ 1045.639121] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bca01ddc-73d5-4856-bbff-aefad642492a in Status: SUCCESS [ 1045.639513] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.639562] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.639760] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.639974] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.640129] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.640200] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.640356] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.640459] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.640565] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.640656] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bca01ddc-73d5-4856-bbff-aefad642492a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.010895] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 in Status: SUCCESS [ 1046.010895] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.144244] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-bca01ddc-73d5-4856-bbff-aefad642492a taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.144502] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.144502] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.144809] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.145196] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.145438] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.145533] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.145671] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.146145] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.146145] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.146292] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-bca01ddc-73d5-4856-bbff-aefad642492a taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.146353] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.146389] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.147299] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.147299] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.147299] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.147299] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.147299] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.147605] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.147605] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.147798] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bca01ddc-73d5-4856-bbff-aefad642492a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.331666] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3507e503-4abd-47ec-8347-82fc9e691881 in Status: SUCCESS [ 1046.334156] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.334156] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.334156] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.334156] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.334156] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.334156] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.334156] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.334156] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.334156] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.334156] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3507e503-4abd-47ec-8347-82fc9e691881',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.653407] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bca01ddc-73d5-4856-bbff-aefad642492a: rpc.has_security_group_logging(os_id): False [ 1046.673916] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.674193] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.674299] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.674488] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.676085] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.676085] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.676241] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.676241] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.676378] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.676463] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.676656] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.676760] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.676819] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.676970] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.677352] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.677567] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.677742] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.677821] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.677980] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.678075] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.678167] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bca01ddc-73d5-4856-bbff-aefad642492a is going to be updated. [ 1046.745721] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.747997] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.747997] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.747997] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.747997] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.760810] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bca01ddc-73d5-4856-bbff-aefad642492a in Status: IN_PROGRESS for 2s [ 1046.836456] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-3507e503-4abd-47ec-8347-82fc9e691881 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.839903] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.839903] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.839903] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.839903] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.839903] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.839903] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.839903] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.839903] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.839903] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.839903] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-3507e503-4abd-47ec-8347-82fc9e691881 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.839903] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.839903] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.839903] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.839903] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.839903] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.839903] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.839903] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.839903] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.840776] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.840776] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3507e503-4abd-47ec-8347-82fc9e691881',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.908843] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1046.908843] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1047.153197] env[70392]: INFO networking_nsxv3.common.synchronization [None req-677cf386-f998-449b-beab-2b9d64d3ca4a tempest-AttachInterfacesTestJSON-2046649887 tempest-AttachInterfacesTestJSON-2046649887-project-member] Enqueued Resource ID: 3507e503-4abd-47ec-8347-82fc9e691881 with Priority: HIGHEST for action security_group_members [ 1047.153197] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3507e503-4abd-47ec-8347-82fc9e691881 with Priority: HIGHEST for action security_group_members [ 1047.153197] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-3507e503-4abd-47ec-8347-82fc9e691881 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.153197] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.153197] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.153197] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.153197] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.153816] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.154194] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.154531] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.154760] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.154974] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3507e503-4abd-47ec-8347-82fc9e691881',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.348145] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3507e503-4abd-47ec-8347-82fc9e691881: rpc.has_security_group_logging(os_id): False [ 1047.367391] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.367391] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.367497] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.368221] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.368221] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.368221] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.368221] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.368221] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.368562] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.368562] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.368630] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.368706] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.368771] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.368909] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.368986] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.369196] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.369290] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.369345] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.369487] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.369560] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.369720] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3507e503-4abd-47ec-8347-82fc9e691881 is going to be updated. [ 1047.450599] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.450599] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.450599] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.450599] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.450599] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.461196] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3507e503-4abd-47ec-8347-82fc9e691881 in Status: IN_PROGRESS for 2s [ 1047.657020] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3507e503-4abd-47ec-8347-82fc9e691881',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.162583] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3507e503-4abd-47ec-8347-82fc9e691881',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.667055] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.667055] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.667055] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.667055] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.667055] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.667055] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3507e503-4abd-47ec-8347-82fc9e691881 is going to be updated. [ 1048.703514] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.703514] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.703514] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.703652] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.703858] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.716566] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3507e503-4abd-47ec-8347-82fc9e691881 in Status: IN_PROGRESS for 2s [ 1048.782282] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bca01ddc-73d5-4856-bbff-aefad642492a in Status: SUCCESS [ 1048.782476] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.795414] env[70392]: INFO networking_nsxv3.common.synchronization [req-c84e27be-11b9-4d94-a093-d06926f08fd4 req-89f6ab98-b2e0-4414-b524-b90005a9641b tempest-ServersTestManualDisk-1686983804 tempest-ServersTestManualDisk-1686983804-project-member] Enqueued Resource ID: 07383bb9-9bd2-43da-8cb5-da905d6129d5 with Priority: HIGHEST for action security_group_members [ 1048.795885] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07383bb9-9bd2-43da-8cb5-da905d6129d5 with Priority: HIGHEST for action security_group_members [ 1048.796137] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-07383bb9-9bd2-43da-8cb5-da905d6129d5 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.796257] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07383bb9-9bd2-43da-8cb5-da905d6129d5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.797477] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07383bb9-9bd2-43da-8cb5-da905d6129d5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.797817] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07383bb9-9bd2-43da-8cb5-da905d6129d5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.798075] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.799989] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.800099] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.800305] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.800438] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.800547] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07383bb9-9bd2-43da-8cb5-da905d6129d5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.297685] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-353 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.297685] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-353" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.297685] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-353" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.297685] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-353" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.297685] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.297685] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.297685] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.297685] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.297685] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.297685] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1049.298290] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1049.298615] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1049.298811] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1049.298952] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1049.299094] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1049.299253] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1049.302612] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.302735] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.302822] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.303267] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.303413] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.303626] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.303732] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.304292] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.304292] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.304292] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.304458] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07383bb9-9bd2-43da-8cb5-da905d6129d5 already deleted. [ 1049.304458] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07383bb9-9bd2-43da-8cb5-da905d6129d5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.321163] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1049.321379] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1049.321534] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1049.321737] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-353" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.322223] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-f857444f-e299-4fb5-b7bb-9660ef8a0f4d taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.322364] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-f857444f-e299-4fb5-b7bb-9660ef8a0f4d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.322629] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-f857444f-e299-4fb5-b7bb-9660ef8a0f4d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.323333] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-f857444f-e299-4fb5-b7bb-9660ef8a0f4d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.323521] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f857444f-e299-4fb5-b7bb-9660ef8a0f4d',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.475384] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3507e503-4abd-47ec-8347-82fc9e691881 in Status: SUCCESS [ 1049.475623] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.827580] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.827580] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.828159] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.828159] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.828279] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.828459] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port f857444f-e299-4fb5-b7bb-9660ef8a0f4d not found, creating... [ 1049.828815] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.829021] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.829162] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.829457] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.829621] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.829931] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.834184] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.834400] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.834696] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.834869] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.835084] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: f857444f-e299-4fb5-b7bb-9660ef8a0f4d is going to be created. [ 1049.866039] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.866039] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.866039] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.866039] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.866039] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.866039] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-f857444f-e299-4fb5-b7bb-9660ef8a0f4d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.899542] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-328 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.899743] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.899908] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.900189] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.900461] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.900624] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.900748] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.900981] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.901152] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.901373] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1049.901491] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1049.901768] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1049.901768] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1049.901938] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1049.902130] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1049.902130] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1049.928967] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1049.929203] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1049.929353] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1049.929536] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.929854] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-496529f2-2fbc-4064-9376-998ff93511c7 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.930043] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-496529f2-2fbc-4064-9376-998ff93511c7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.930205] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-496529f2-2fbc-4064-9376-998ff93511c7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.930502] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-496529f2-2fbc-4064-9376-998ff93511c7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.930654] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('496529f2-2fbc-4064-9376-998ff93511c7',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.437748] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.437748] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.437748] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.438688] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.440483] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.440483] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 496529f2-2fbc-4064-9376-998ff93511c7 not found, creating... [ 1050.440483] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.440483] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.440483] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.440483] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.440483] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.442248] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.445480] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.445480] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.445480] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.445480] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.445480] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 496529f2-2fbc-4064-9376-998ff93511c7 is going to be created. [ 1050.472431] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.472431] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.472431] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.472431] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.472431] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.472431] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-496529f2-2fbc-4064-9376-998ff93511c7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.729235] env[70392]: INFO networking_nsxv3.common.synchronization [req-c84e27be-11b9-4d94-a093-d06926f08fd4 req-0344de87-2f04-4199-9d29-ffe7fbd9ef44 service nova] Enqueued Resource ID: 07383bb9-9bd2-43da-8cb5-da905d6129d5 with Priority: HIGHEST for action security_group_rules [ 1050.729235] env[70392]: INFO networking_nsxv3.common.synchronization [req-c84e27be-11b9-4d94-a093-d06926f08fd4 req-0344de87-2f04-4199-9d29-ffe7fbd9ef44 service nova] Enqueued Resource ID: 07383bb9-9bd2-43da-8cb5-da905d6129d5 with Priority: HIGHEST for action security_group_members [ 1050.729235] env[70392]: INFO networking_nsxv3.common.synchronization [req-c84e27be-11b9-4d94-a093-d06926f08fd4 req-0344de87-2f04-4199-9d29-ffe7fbd9ef44 service nova] Enqueued Resource ID: f857444f-e299-4fb5-b7bb-9660ef8a0f4d with Priority: HIGHEST for action port [ 1050.731549] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3507e503-4abd-47ec-8347-82fc9e691881 in Status: SUCCESS [ 1050.731549] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.731549] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07383bb9-9bd2-43da-8cb5-da905d6129d5 with Priority: HIGHEST for action security_group_rules [ 1050.732459] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07383bb9-9bd2-43da-8cb5-da905d6129d5 with Priority: HIGHEST for action security_group_members [ 1050.732459] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f857444f-e299-4fb5-b7bb-9660ef8a0f4d with Priority: HIGHEST for action port [ 1050.733800] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07383bb9-9bd2-43da-8cb5-da905d6129d5 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.734943] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07383bb9-9bd2-43da-8cb5-da905d6129d5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.734943] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07383bb9-9bd2-43da-8cb5-da905d6129d5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.734943] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07383bb9-9bd2-43da-8cb5-da905d6129d5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.735146] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07383bb9-9bd2-43da-8cb5-da905d6129d5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.736669] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-07383bb9-9bd2-43da-8cb5-da905d6129d5 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.736793] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07383bb9-9bd2-43da-8cb5-da905d6129d5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.736873] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07383bb9-9bd2-43da-8cb5-da905d6129d5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.737086] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07383bb9-9bd2-43da-8cb5-da905d6129d5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.737337] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.737441] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.737502] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.737657] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.737739] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.737858] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07383bb9-9bd2-43da-8cb5-da905d6129d5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.738813] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-f857444f-e299-4fb5-b7bb-9660ef8a0f4d taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.738917] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f857444f-e299-4fb5-b7bb-9660ef8a0f4d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.738959] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f857444f-e299-4fb5-b7bb-9660ef8a0f4d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.739098] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f857444f-e299-4fb5-b7bb-9660ef8a0f4d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.739201] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f857444f-e299-4fb5-b7bb-9660ef8a0f4d',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.211886] env[70392]: INFO networking_nsxv3.common.synchronization [req-ec363002-b0b2-452d-a14d-ef696028f876 req-9ce80c9d-46bc-4bea-8c04-8e1f9da428d0 service nova] Enqueued Resource ID: 3507e503-4abd-47ec-8347-82fc9e691881 with Priority: HIGHEST for action security_group_rules [ 1051.212234] env[70392]: INFO networking_nsxv3.common.synchronization [req-ec363002-b0b2-452d-a14d-ef696028f876 req-9ce80c9d-46bc-4bea-8c04-8e1f9da428d0 service nova] Enqueued Resource ID: 3507e503-4abd-47ec-8347-82fc9e691881 with Priority: HIGHEST for action security_group_members [ 1051.212487] env[70392]: INFO networking_nsxv3.common.synchronization [req-ec363002-b0b2-452d-a14d-ef696028f876 req-9ce80c9d-46bc-4bea-8c04-8e1f9da428d0 service nova] Enqueued Resource ID: 496529f2-2fbc-4064-9376-998ff93511c7 with Priority: HIGHEST for action port [ 1051.212805] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3507e503-4abd-47ec-8347-82fc9e691881 with Priority: HIGHEST for action security_group_rules [ 1051.213451] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3507e503-4abd-47ec-8347-82fc9e691881 with Priority: HIGHEST for action security_group_members [ 1051.213451] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 496529f2-2fbc-4064-9376-998ff93511c7 with Priority: HIGHEST for action port [ 1051.213851] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3507e503-4abd-47ec-8347-82fc9e691881 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.213924] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.213982] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.214232] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.214433] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3507e503-4abd-47ec-8347-82fc9e691881',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.215807] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-3507e503-4abd-47ec-8347-82fc9e691881 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.215963] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.216146] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.216236] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.216417] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.216525] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.216583] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.216760] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.216847] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.216938] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3507e503-4abd-47ec-8347-82fc9e691881',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.221506] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-496529f2-2fbc-4064-9376-998ff93511c7 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.221506] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-496529f2-2fbc-4064-9376-998ff93511c7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.221506] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-496529f2-2fbc-4064-9376-998ff93511c7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.221506] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-496529f2-2fbc-4064-9376-998ff93511c7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.221506] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('496529f2-2fbc-4064-9376-998ff93511c7',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.241083] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-07383bb9-9bd2-43da-8cb5-da905d6129d5 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.241297] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07383bb9-9bd2-43da-8cb5-da905d6129d5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.243899] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('07383bb9-9bd2-43da-8cb5-da905d6129d5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.246914] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f857444f-e299-4fb5-b7bb-9660ef8a0f4d with status ACTIVE [ 1051.247114] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.247259] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.247368] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.247525] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.247623] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.247785] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.247885] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.247948] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.248311] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.248311] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.248505] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.248505] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.248505] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.249070] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.249070] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.249070] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f857444f-e299-4fb5-b7bb-9660ef8a0f4d is going to be updated. [ 1051.273139] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.273411] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.273490] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.273744] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.273908] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.274147] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f857444f-e299-4fb5-b7bb-9660ef8a0f4d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.463200] env[70392]: INFO networking_nsxv3.common.synchronization [req-c0960dd1-fe7b-49a4-9404-878d4442d62a req-c337cc2d-107d-4ef5-8c59-b5d902bbad08 tempest-DeleteServersTestJSON-1676313022 tempest-DeleteServersTestJSON-1676313022-project-member] Enqueued Resource ID: ce79170a-31ce-429e-8e08-a911557872f4 with Priority: HIGHEST for action security_group_members [ 1051.463811] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce79170a-31ce-429e-8e08-a911557872f4 with Priority: HIGHEST for action security_group_members [ 1051.467046] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce79170a-31ce-429e-8e08-a911557872f4 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.467187] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.467264] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.467769] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.468220] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.468350] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.468394] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.470441] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.470545] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.470682] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce79170a-31ce-429e-8e08-a911557872f4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.721376] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-3507e503-4abd-47ec-8347-82fc9e691881 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.721568] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.725743] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3507e503-4abd-47ec-8347-82fc9e691881',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.726249] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 496529f2-2fbc-4064-9376-998ff93511c7 with status ACTIVE [ 1051.726447] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.726578] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.726639] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.726824] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.726906] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.727098] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.727200] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.727310] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.730101] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.730101] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.730101] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.730101] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.730101] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.730101] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.730101] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.730101] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 496529f2-2fbc-4064-9376-998ff93511c7 is going to be updated. [ 1051.746308] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('07383bb9-9bd2-43da-8cb5-da905d6129d5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.750514] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.750807] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.750935] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.751209] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.751404] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.753019] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-496529f2-2fbc-4064-9376-998ff93511c7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.974014] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.974216] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.974297] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.974530] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.974622] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.974819] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.974915] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.974963] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.975127] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.975219] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.975307] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce79170a-31ce-429e-8e08-a911557872f4 is going to be updated. [ 1052.009772] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.009957] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.010012] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.010273] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.010390] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.020753] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce79170a-31ce-429e-8e08-a911557872f4 in Status: IN_PROGRESS for 2s [ 1052.051240] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-422 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.051410] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-422" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.051535] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-422" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.051808] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-422" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.052084] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.052254] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.053972] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.053972] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.053972] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.053972] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1052.053972] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1052.054582] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1052.054665] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1052.054836] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1052.055040] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1052.055686] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1052.083972] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1052.085848] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1052.085848] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1052.085848] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-422" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.085848] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-ebd5957e-ee6f-496f-a488-44df1e282595 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.085848] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-ebd5957e-ee6f-496f-a488-44df1e282595" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.085848] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-ebd5957e-ee6f-496f-a488-44df1e282595" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.086249] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-ebd5957e-ee6f-496f-a488-44df1e282595" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.086249] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ebd5957e-ee6f-496f-a488-44df1e282595',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.230636] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3507e503-4abd-47ec-8347-82fc9e691881',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.248268] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.248491] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.248535] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.248726] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.248819] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.248928] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07383bb9-9bd2-43da-8cb5-da905d6129d5 is going to be created. [ 1052.291938] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.292199] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.292355] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.292537] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.292679] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.327895] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07383bb9-9bd2-43da-8cb5-da905d6129d5 in Status: UNINITIALIZED for 2s [ 1052.589056] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.589298] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.589427] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.589708] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.589864] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.590050] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port ebd5957e-ee6f-496f-a488-44df1e282595 not found, creating... [ 1052.590320] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.590483] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.590635] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.591700] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.591700] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.591700] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.591700] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.591700] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.592046] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.594190] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.594190] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: ebd5957e-ee6f-496f-a488-44df1e282595 is going to be created. [ 1052.620072] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.620226] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.620355] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.620929] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.621204] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.621923] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-ebd5957e-ee6f-496f-a488-44df1e282595" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.733144] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.733312] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.733385] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.733605] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.733698] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.733801] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3507e503-4abd-47ec-8347-82fc9e691881 is going to be updated. [ 1052.778458] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.778737] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.778737] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.779164] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.779164] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.790286] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3507e503-4abd-47ec-8347-82fc9e691881 in Status: IN_PROGRESS for 2s [ 1053.435149] env[70392]: INFO networking_nsxv3.common.synchronization [req-c0960dd1-fe7b-49a4-9404-878d4442d62a req-cade4907-83b6-4f1e-aed6-87b1efe07e6d service nova] Enqueued Resource ID: ce79170a-31ce-429e-8e08-a911557872f4 with Priority: HIGHEST for action security_group_rules [ 1053.435484] env[70392]: INFO networking_nsxv3.common.synchronization [req-c0960dd1-fe7b-49a4-9404-878d4442d62a req-cade4907-83b6-4f1e-aed6-87b1efe07e6d service nova] Enqueued Resource ID: ce79170a-31ce-429e-8e08-a911557872f4 with Priority: HIGHEST for action security_group_members [ 1053.435484] env[70392]: INFO networking_nsxv3.common.synchronization [req-c0960dd1-fe7b-49a4-9404-878d4442d62a req-cade4907-83b6-4f1e-aed6-87b1efe07e6d service nova] Enqueued Resource ID: ebd5957e-ee6f-496f-a488-44df1e282595 with Priority: HIGHEST for action port [ 1053.435837] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce79170a-31ce-429e-8e08-a911557872f4 with Priority: HIGHEST for action security_group_rules [ 1053.435837] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce79170a-31ce-429e-8e08-a911557872f4 with Priority: HIGHEST for action security_group_members [ 1053.437409] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebd5957e-ee6f-496f-a488-44df1e282595 with Priority: HIGHEST for action port [ 1053.437409] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ce79170a-31ce-429e-8e08-a911557872f4 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.437409] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.437409] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.437409] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.437409] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ce79170a-31ce-429e-8e08-a911557872f4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.441418] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce79170a-31ce-429e-8e08-a911557872f4 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.441603] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.441843] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-ebd5957e-ee6f-496f-a488-44df1e282595 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.441843] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ebd5957e-ee6f-496f-a488-44df1e282595" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.442066] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ebd5957e-ee6f-496f-a488-44df1e282595" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.442066] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ebd5957e-ee6f-496f-a488-44df1e282595" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.442208] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ebd5957e-ee6f-496f-a488-44df1e282595',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.944679] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ebd5957e-ee6f-496f-a488-44df1e282595 with status ACTIVE [ 1053.944860] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.944941] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.945248] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.945509] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.945603] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.945805] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.946091] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.946091] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.946250] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.949752] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.949752] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.949752] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.949752] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.949752] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.949752] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.949752] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ebd5957e-ee6f-496f-a488-44df1e282595 is going to be updated. [ 1053.949752] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce79170a-31ce-429e-8e08-a911557872f4 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.949752] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.970066] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.970314] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.970392] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.970718] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.970950] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.971162] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ebd5957e-ee6f-496f-a488-44df1e282595" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.033058] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce79170a-31ce-429e-8e08-a911557872f4 in Status: SUCCESS [ 1054.033058] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce79170a-31ce-429e-8e08-a911557872f4 deletion is rescheduled due to dependency. [ 1054.033058] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.033058] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.033058] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.033058] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.033058] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.033058] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.033058] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.033058] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.033058] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce79170a-31ce-429e-8e08-a911557872f4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.286754] env[70392]: INFO networking_nsxv3.common.synchronization [req-7784afc6-057f-491f-a48d-fef96589500f req-9b46f090-1389-4565-a926-e34d192c8def tempest-ServersNegativeTestJSON-1387658603 tempest-ServersNegativeTestJSON-1387658603-project-member] Enqueued Resource ID: c3e59ae3-629d-4146-9bee-ef9808a03841 with Priority: HIGHEST for action security_group_members [ 1054.288075] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3e59ae3-629d-4146-9bee-ef9808a03841 with Priority: HIGHEST for action security_group_members [ 1054.288492] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3e59ae3-629d-4146-9bee-ef9808a03841 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.288591] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.288591] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.289060] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.289534] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.289691] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.289781] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.290075] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.290193] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.290302] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c3e59ae3-629d-4146-9bee-ef9808a03841',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.338301] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07383bb9-9bd2-43da-8cb5-da905d6129d5 in Status: SUCCESS [ 1054.338521] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07383bb9-9bd2-43da-8cb5-da905d6129d5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.338697] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07383bb9-9bd2-43da-8cb5-da905d6129d5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.338932] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07383bb9-9bd2-43da-8cb5-da905d6129d5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.339149] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.339264] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.339332] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.339497] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.339574] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.339649] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07383bb9-9bd2-43da-8cb5-da905d6129d5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.339742] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('07383bb9-9bd2-43da-8cb5-da905d6129d5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.535262] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ce79170a-31ce-429e-8e08-a911557872f4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.793727] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.793727] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.793727] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.793727] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.793958] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.794231] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.794681] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.794681] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.794681] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.794882] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.794882] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3e59ae3-629d-4146-9bee-ef9808a03841 already deleted. [ 1054.794982] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.800935] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3507e503-4abd-47ec-8347-82fc9e691881 in Status: SUCCESS [ 1054.801204] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.801371] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.801558] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.801747] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.801872] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.801977] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.802188] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.802308] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.802442] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.802584] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3507e503-4abd-47ec-8347-82fc9e691881',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.846412] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('07383bb9-9bd2-43da-8cb5-da905d6129d5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.038176] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ce79170a-31ce-429e-8e08-a911557872f4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.174622] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-657 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.174923] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-657" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.174992] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-657" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.175362] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-657" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.176267] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.176582] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.176761] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.177178] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.177460] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.177931] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1055.178245] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1055.178536] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1055.178635] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1055.178796] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1055.178944] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1055.179136] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1055.201084] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1055.201415] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1055.201686] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1055.201906] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-657" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.202230] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-9269b225-75e0-47ce-a7c2-5da9a065ea61 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.202415] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-9269b225-75e0-47ce-a7c2-5da9a065ea61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.202610] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-9269b225-75e0-47ce-a7c2-5da9a065ea61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.202975] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-9269b225-75e0-47ce-a7c2-5da9a065ea61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.203283] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9269b225-75e0-47ce-a7c2-5da9a065ea61',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.306945] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-3507e503-4abd-47ec-8347-82fc9e691881 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.307147] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.307222] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.307453] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.307632] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.307739] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.307786] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.307946] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.308143] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.308143] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.308351] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-3507e503-4abd-47ec-8347-82fc9e691881 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.308479] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.308479] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.308598] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.308702] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.308796] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.309016] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.309016] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.309104] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.309136] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.309230] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3507e503-4abd-47ec-8347-82fc9e691881',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.351142] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 07383bb9-9bd2-43da-8cb5-da905d6129d5: rpc.has_security_group_logging(os_id): False [ 1055.380440] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.380589] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.380676] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.382114] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.382284] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.382721] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.385179] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.385179] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.385179] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.385179] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.385179] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07383bb9-9bd2-43da-8cb5-da905d6129d5 is going to be created. [ 1055.479038] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.479271] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.479271] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.479501] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.479677] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.495512] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07383bb9-9bd2-43da-8cb5-da905d6129d5 in Status: IN_PROGRESS for 2s [ 1055.545214] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.545597] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.545597] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.545687] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.545814] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.545928] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce79170a-31ce-429e-8e08-a911557872f4 is going to be updated. [ 1055.615055] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.615055] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.615055] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.615055] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.615055] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.626057] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce79170a-31ce-429e-8e08-a911557872f4 in Status: IN_PROGRESS for 2s [ 1055.708070] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.708355] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.708578] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.708924] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.709151] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.709388] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 9269b225-75e0-47ce-a7c2-5da9a065ea61 not found, creating... [ 1055.709716] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.709949] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.710187] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.710420] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.710694] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.711148] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.711367] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.711525] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.711816] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.711993] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.712274] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 9269b225-75e0-47ce-a7c2-5da9a065ea61 is going to be created. [ 1055.735705] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.735962] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.736092] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.736723] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.736723] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.736870] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-9269b225-75e0-47ce-a7c2-5da9a065ea61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.811625] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3507e503-4abd-47ec-8347-82fc9e691881: rpc.has_security_group_logging(os_id): False [ 1055.832723] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.832723] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.832910] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.833046] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.833272] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.833601] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.833938] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.833938] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.834245] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.834245] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.834423] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.837280] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.837280] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.837280] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.837280] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.837280] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.837280] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.837280] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.837280] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.837280] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.837782] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3507e503-4abd-47ec-8347-82fc9e691881 is going to be updated. [ 1055.971424] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.971687] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.971788] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.972147] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.972332] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.990088] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3507e503-4abd-47ec-8347-82fc9e691881 in Status: IN_PROGRESS for 2s [ 1056.561816] env[70392]: INFO networking_nsxv3.common.synchronization [req-7784afc6-057f-491f-a48d-fef96589500f req-a78f1f0c-2d36-4770-8a5b-7d0b3991c2fb service nova] Enqueued Resource ID: c3e59ae3-629d-4146-9bee-ef9808a03841 with Priority: HIGHEST for action security_group_rules [ 1056.562296] env[70392]: INFO networking_nsxv3.common.synchronization [req-7784afc6-057f-491f-a48d-fef96589500f req-a78f1f0c-2d36-4770-8a5b-7d0b3991c2fb service nova] Enqueued Resource ID: c3e59ae3-629d-4146-9bee-ef9808a03841 with Priority: HIGHEST for action security_group_members [ 1056.562469] env[70392]: INFO networking_nsxv3.common.synchronization [req-7784afc6-057f-491f-a48d-fef96589500f req-a78f1f0c-2d36-4770-8a5b-7d0b3991c2fb service nova] Enqueued Resource ID: 9269b225-75e0-47ce-a7c2-5da9a065ea61 with Priority: HIGHEST for action port [ 1056.564937] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3e59ae3-629d-4146-9bee-ef9808a03841 with Priority: HIGHEST for action security_group_rules [ 1056.564937] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3e59ae3-629d-4146-9bee-ef9808a03841 with Priority: HIGHEST for action security_group_members [ 1056.564937] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9269b225-75e0-47ce-a7c2-5da9a065ea61 with Priority: HIGHEST for action port [ 1056.564937] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c3e59ae3-629d-4146-9bee-ef9808a03841 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.564937] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.564937] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.564937] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.564937] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c3e59ae3-629d-4146-9bee-ef9808a03841',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.566960] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3e59ae3-629d-4146-9bee-ef9808a03841 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.566960] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.566960] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.566960] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.566960] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.566960] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.566960] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.566960] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.566960] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.567402] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c3e59ae3-629d-4146-9bee-ef9808a03841',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.571627] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-9269b225-75e0-47ce-a7c2-5da9a065ea61 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.571627] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9269b225-75e0-47ce-a7c2-5da9a065ea61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.571627] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9269b225-75e0-47ce-a7c2-5da9a065ea61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.571888] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9269b225-75e0-47ce-a7c2-5da9a065ea61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.571888] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9269b225-75e0-47ce-a7c2-5da9a065ea61',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.077340] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9269b225-75e0-47ce-a7c2-5da9a065ea61 with status ACTIVE [ 1057.077340] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.077340] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.077340] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.077340] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.077340] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.077340] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.077340] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.077340] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.077340] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.077340] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.077340] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.077340] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.077340] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.077340] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.077340] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.077340] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9269b225-75e0-47ce-a7c2-5da9a065ea61 is going to be updated. [ 1057.078092] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3e59ae3-629d-4146-9bee-ef9808a03841 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.078092] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.080317] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c3e59ae3-629d-4146-9bee-ef9808a03841',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.102157] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.102320] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.102386] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.102593] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.102730] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.102888] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9269b225-75e0-47ce-a7c2-5da9a065ea61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.509131] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07383bb9-9bd2-43da-8cb5-da905d6129d5 in Status: SUCCESS [ 1057.509384] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07383bb9-9bd2-43da-8cb5-da905d6129d5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.583114] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c3e59ae3-629d-4146-9bee-ef9808a03841',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.636776] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce79170a-31ce-429e-8e08-a911557872f4 in Status: SUCCESS [ 1057.636956] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.637063] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.637359] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.637619] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.637816] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.637920] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.638153] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.638263] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.638392] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.638545] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ce79170a-31ce-429e-8e08-a911557872f4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.009779] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3507e503-4abd-47ec-8347-82fc9e691881 in Status: SUCCESS [ 1058.009779] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.086300] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.087424] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.087424] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.087424] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.087424] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.087424] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3e59ae3-629d-4146-9bee-ef9808a03841 is going to be created. [ 1058.113340] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.113663] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.113663] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.113850] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.113980] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.130334] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3e59ae3-629d-4146-9bee-ef9808a03841 in Status: UNINITIALIZED for 2s [ 1058.142549] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce79170a-31ce-429e-8e08-a911557872f4 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.142720] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.142764] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.142963] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.143152] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.143250] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.143314] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.143471] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.143557] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.143643] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.143792] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce79170a-31ce-429e-8e08-a911557872f4 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.143881] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.143943] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.144102] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.144267] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.144365] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.144424] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.144599] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.144700] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.144758] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.144808] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ce79170a-31ce-429e-8e08-a911557872f4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.648297] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ce79170a-31ce-429e-8e08-a911557872f4: rpc.has_security_group_logging(os_id): False [ 1058.671314] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.671488] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.671570] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.671803] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.671935] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.672225] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.672367] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.672414] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.672613] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.672700] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.672933] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.673035] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.673107] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.673261] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.673367] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.673531] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.673656] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.673719] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.673870] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.674015] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.674754] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ce79170a-31ce-429e-8e08-a911557872f4 is going to be updated. [ 1058.761912] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.761912] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.761912] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.761912] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.762304] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.779771] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ce79170a-31ce-429e-8e08-a911557872f4 in Status: IN_PROGRESS for 2s [ 1060.146023] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3e59ae3-629d-4146-9bee-ef9808a03841 in Status: SUCCESS [ 1060.146023] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.146023] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.146023] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.146023] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.146023] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.146023] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.146023] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.146023] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.146656] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.146656] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c3e59ae3-629d-4146-9bee-ef9808a03841',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.594118] env[70392]: INFO networking_nsxv3.common.synchronization [req-571924f7-ce25-43eb-b5ca-2c4d9ee2cb47 req-5b4cc3e6-65c8-43a4-ba61-a79b5bff790f tempest-ListServerFiltersTestJSON-50551211 tempest-ListServerFiltersTestJSON-50551211-project-member] Enqueued Resource ID: 4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 with Priority: HIGHEST for action security_group_members [ 1060.594118] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 with Priority: HIGHEST for action security_group_members [ 1060.594118] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.594118] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.594118] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.594118] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.594118] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.595130] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.595292] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.595588] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.596430] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.596430] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f7f8865-743f-4e67-8bf2-9a21ed1eaac4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.649617] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3e59ae3-629d-4146-9bee-ef9808a03841 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.649617] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.649617] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.651618] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.651618] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.651618] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.651618] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.651618] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.651618] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.651618] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.651618] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3e59ae3-629d-4146-9bee-ef9808a03841 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.651618] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.651618] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.651618] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.652346] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.652346] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.652440] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.652671] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.652754] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.653552] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.653552] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c3e59ae3-629d-4146-9bee-ef9808a03841',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.799189] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ce79170a-31ce-429e-8e08-a911557872f4 in Status: SUCCESS [ 1060.799545] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.099543] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4f7f8865-743f-4e67-8bf2-9a21ed1eaac4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.155460] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c3e59ae3-629d-4146-9bee-ef9808a03841: rpc.has_security_group_logging(os_id): False [ 1061.176940] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.177132] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.177211] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.177375] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.177459] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.177644] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.177816] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.177816] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.177980] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.180018] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.180018] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.180018] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.180018] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.180018] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.180018] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.180018] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.180018] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.180018] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.180018] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.180018] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.180018] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c3e59ae3-629d-4146-9bee-ef9808a03841 is going to be created. [ 1061.358569] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.358569] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.358569] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.358891] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.358995] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.376263] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c3e59ae3-629d-4146-9bee-ef9808a03841 in Status: IN_PROGRESS for 2s [ 1061.602460] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4f7f8865-743f-4e67-8bf2-9a21ed1eaac4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.737031] env[70392]: INFO networking_nsxv3.common.synchronization [req-bff3b0de-02fe-43fe-a71c-b127f37f2e35 req-9c0cc691-6c3b-465e-b6a5-60dd9dd7863c tempest-AttachVolumeNegativeTest-772339566 tempest-AttachVolumeNegativeTest-772339566-project-member] Enqueued Resource ID: 43327972-df6d-4e69-b782-fda3a340af0a with Priority: HIGHEST for action security_group_members [ 1061.737603] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43327972-df6d-4e69-b782-fda3a340af0a with Priority: HIGHEST for action security_group_members [ 1061.739992] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-43327972-df6d-4e69-b782-fda3a340af0a taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.740198] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43327972-df6d-4e69-b782-fda3a340af0a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.740280] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43327972-df6d-4e69-b782-fda3a340af0a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.740477] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43327972-df6d-4e69-b782-fda3a340af0a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.743284] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.743541] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.743541] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.743770] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.743863] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.744050] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43327972-df6d-4e69-b782-fda3a340af0a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.104852] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.105030] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.105099] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.105314] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.105570] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.105693] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 is going to be updated. [ 1062.150205] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.150371] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.150448] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.150679] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.151020] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.169917] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 in Status: IN_PROGRESS for 2s [ 1062.251025] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.251025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.251025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.251025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.251025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.251025] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.251025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.251025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.251025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.251025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.251025] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43327972-df6d-4e69-b782-fda3a340af0a is going to be updated. [ 1062.320780] env[70392]: INFO networking_nsxv3.common.synchronization [req-c311139b-6614-47ac-af6f-ee2b4502d80c req-1f1a9661-f1f9-4e26-9f00-8012ea06c790 tempest-ServersTestJSON-507292717 tempest-ServersTestJSON-507292717-project-member] Enqueued Resource ID: 19062702-bd29-4477-a732-5169f347b4da with Priority: HIGHEST for action security_group_members [ 1062.321392] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19062702-bd29-4477-a732-5169f347b4da with Priority: HIGHEST for action security_group_members [ 1062.321716] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-19062702-bd29-4477-a732-5169f347b4da taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.321840] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.321906] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.326028] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.326028] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.326028] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.326028] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.326028] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.326028] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.326028] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.328275] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.328431] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.328511] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.328858] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.328858] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.348143] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43327972-df6d-4e69-b782-fda3a340af0a in Status: IN_PROGRESS for 2s [ 1062.504901] env[70392]: INFO networking_nsxv3.common.synchronization [req-ad60b7ec-bb45-4b30-bf19-26b5f2714134 req-80410fee-da5b-4053-aa5d-091221336fe9 tempest-ListImageFiltersTestJSON-1434659708 tempest-ListImageFiltersTestJSON-1434659708-project-member] Enqueued Resource ID: 49e97029-e971-47d3-aa73-0fe54ba5d0b0 with Priority: HIGHEST for action security_group_members [ 1062.505628] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49e97029-e971-47d3-aa73-0fe54ba5d0b0 with Priority: HIGHEST for action security_group_members [ 1062.505896] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-49e97029-e971-47d3-aa73-0fe54ba5d0b0 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.506039] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49e97029-e971-47d3-aa73-0fe54ba5d0b0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.506108] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49e97029-e971-47d3-aa73-0fe54ba5d0b0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.506316] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49e97029-e971-47d3-aa73-0fe54ba5d0b0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.506476] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.506577] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.506642] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.506789] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.506868] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.506962] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49e97029-e971-47d3-aa73-0fe54ba5d0b0',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.826134] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.009743] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.010905] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.010905] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.011102] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.052412] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.052412] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.052412] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.052412] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.052771] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.052771] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.055572] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49e97029-e971-47d3-aa73-0fe54ba5d0b0 is going to be updated. [ 1063.088670] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.088999] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.088999] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.092402] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.092402] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.105035] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49e97029-e971-47d3-aa73-0fe54ba5d0b0 in Status: IN_PROGRESS for 2s [ 1063.194851] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-219 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.195195] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-219" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.195195] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-219" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.195540] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-219" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.195854] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.196054] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.196185] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.196664] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.196664] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.196870] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1063.197043] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1063.197157] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1063.197293] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1063.197423] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1063.197565] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1063.197718] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1063.241961] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1063.242059] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.044 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1063.242177] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1063.242409] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-219" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.242785] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-59ab41ed-f8e1-4872-a62a-c2694667d347 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.242965] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-59ab41ed-f8e1-4872-a62a-c2694667d347" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.243098] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-59ab41ed-f8e1-4872-a62a-c2694667d347" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.243542] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-59ab41ed-f8e1-4872-a62a-c2694667d347" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.245214] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('59ab41ed-f8e1-4872-a62a-c2694667d347',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.328435] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.390506] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c3e59ae3-629d-4146-9bee-ef9808a03841 in Status: SUCCESS [ 1063.394188] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.747910] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.748159] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.748469] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.748709] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.748869] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.749060] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 59ab41ed-f8e1-4872-a62a-c2694667d347 not found, creating... [ 1063.749355] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.749525] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.749646] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.749888] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.753080] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.753517] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.753711] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.753838] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.754152] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.754251] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.754478] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 59ab41ed-f8e1-4872-a62a-c2694667d347 is going to be created. [ 1063.777899] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.778102] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.778222] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.778502] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.778741] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.778974] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-59ab41ed-f8e1-4872-a62a-c2694667d347" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.834995] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.835216] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.835314] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.835616] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.835734] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.835870] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19062702-bd29-4477-a732-5169f347b4da is going to be updated. [ 1063.874556] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.874806] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.874806] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.874966] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.875147] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.889616] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19062702-bd29-4477-a732-5169f347b4da in Status: IN_PROGRESS for 2s [ 1064.183135] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 in Status: SUCCESS [ 1064.184040] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.359325] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43327972-df6d-4e69-b782-fda3a340af0a in Status: SUCCESS [ 1064.359885] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43327972-df6d-4e69-b782-fda3a340af0a deletion is rescheduled due to dependency. [ 1064.359885] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43327972-df6d-4e69-b782-fda3a340af0a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.585624] env[70392]: INFO networking_nsxv3.common.synchronization [req-c311139b-6614-47ac-af6f-ee2b4502d80c req-d52833f6-b136-4209-9bc4-ae5596afe4ea service nova] Enqueued Resource ID: 19062702-bd29-4477-a732-5169f347b4da with Priority: HIGHEST for action security_group_rules [ 1064.585977] env[70392]: INFO networking_nsxv3.common.synchronization [req-c311139b-6614-47ac-af6f-ee2b4502d80c req-d52833f6-b136-4209-9bc4-ae5596afe4ea service nova] Enqueued Resource ID: 19062702-bd29-4477-a732-5169f347b4da with Priority: HIGHEST for action security_group_members [ 1064.587188] env[70392]: INFO networking_nsxv3.common.synchronization [req-c311139b-6614-47ac-af6f-ee2b4502d80c req-d52833f6-b136-4209-9bc4-ae5596afe4ea service nova] Enqueued Resource ID: 59ab41ed-f8e1-4872-a62a-c2694667d347 with Priority: HIGHEST for action port [ 1064.587803] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19062702-bd29-4477-a732-5169f347b4da with Priority: HIGHEST for action security_group_rules [ 1064.588477] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19062702-bd29-4477-a732-5169f347b4da with Priority: HIGHEST for action security_group_members [ 1064.588724] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59ab41ed-f8e1-4872-a62a-c2694667d347 with Priority: HIGHEST for action port [ 1064.589260] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-19062702-bd29-4477-a732-5169f347b4da taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.589576] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.589695] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.595014] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.595161] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.600022] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-19062702-bd29-4477-a732-5169f347b4da taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.600022] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.600022] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-59ab41ed-f8e1-4872-a62a-c2694667d347 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.600022] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-59ab41ed-f8e1-4872-a62a-c2694667d347" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.600022] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-59ab41ed-f8e1-4872-a62a-c2694667d347" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.600022] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-59ab41ed-f8e1-4872-a62a-c2694667d347" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.600022] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('59ab41ed-f8e1-4872-a62a-c2694667d347',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.601287] env[70392]: INFO networking_nsxv3.common.synchronization [req-7337be4e-e022-44c1-bf0a-a4cf8be5757e req-54c344fe-141a-42e3-8705-c0b01f17d3b0 tempest-ServerRescueNegativeTestJSON-197938596 tempest-ServerRescueNegativeTestJSON-197938596-project-member] Enqueued Resource ID: fcc3c75c-0cae-4c7c-8f32-6c948e76880d with Priority: HIGHEST for action security_group_members [ 1064.602351] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcc3c75c-0cae-4c7c-8f32-6c948e76880d with Priority: HIGHEST for action security_group_members [ 1064.603305] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-fcc3c75c-0cae-4c7c-8f32-6c948e76880d taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.603438] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fcc3c75c-0cae-4c7c-8f32-6c948e76880d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.603522] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fcc3c75c-0cae-4c7c-8f32-6c948e76880d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.603723] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fcc3c75c-0cae-4c7c-8f32-6c948e76880d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.603887] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.603989] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.604059] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.604234] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.604329] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.604450] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fcc3c75c-0cae-4c7c-8f32-6c948e76880d',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.100017] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-19062702-bd29-4477-a732-5169f347b4da taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.100212] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.102724] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 59ab41ed-f8e1-4872-a62a-c2694667d347 with status ACTIVE [ 1065.104036] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.104036] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.104036] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.104036] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.105142] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.105142] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.105142] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.105142] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.105142] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.105142] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.106064] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.106064] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.106064] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.106064] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.106064] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.106064] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 59ab41ed-f8e1-4872-a62a-c2694667d347 is going to be updated. [ 1065.115779] env[70392]: INFO networking_nsxv3.common.synchronization [req-b10f1bfe-fd27-4440-a39e-92951c8d2f2c req-265fea78-6bcd-4eb5-98c1-c17572e8af9d tempest-AttachInterfacesTestJSON-2046649887 tempest-AttachInterfacesTestJSON-2046649887-project-member] Enqueued Resource ID: 3507e503-4abd-47ec-8347-82fc9e691881 with Priority: HIGHEST for action security_group_members [ 1065.116571] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.116701] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.116745] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.116938] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.118158] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3507e503-4abd-47ec-8347-82fc9e691881 with Priority: HIGHEST for action security_group_members [ 1065.119125] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-3507e503-4abd-47ec-8347-82fc9e691881 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.120038] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.120038] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.120377] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.121021] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.121501] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.121685] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.121964] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.122183] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.122246] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3507e503-4abd-47ec-8347-82fc9e691881',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.129821] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49e97029-e971-47d3-aa73-0fe54ba5d0b0 in Status: SUCCESS [ 1065.129990] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49e97029-e971-47d3-aa73-0fe54ba5d0b0 deletion is rescheduled due to dependency. [ 1065.130625] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49e97029-e971-47d3-aa73-0fe54ba5d0b0" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.144879] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.145239] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.145420] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.145511] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.145772] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.145878] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.146141] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fcc3c75c-0cae-4c7c-8f32-6c948e76880d is going to be updated. [ 1065.151588] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.151588] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.151588] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.151588] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.151588] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.151588] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-59ab41ed-f8e1-4872-a62a-c2694667d347" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.182623] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.182855] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.182986] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.183261] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.183516] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.200502] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fcc3c75c-0cae-4c7c-8f32-6c948e76880d in Status: IN_PROGRESS for 2s [ 1065.627099] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3507e503-4abd-47ec-8347-82fc9e691881',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.732309] env[70392]: INFO networking_nsxv3.common.synchronization [None req-9d4f0be9-6422-4dd3-b2a0-e06b71ce2724 None None] Enqueued Resource ID: 97befb5b-1df0-4d1a-a7b0-adb698db75b8 with Priority: HIGHEST for action port [ 1065.733105] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97befb5b-1df0-4d1a-a7b0-adb698db75b8 with Priority: HIGHEST for action port [ 1065.733464] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-97befb5b-1df0-4d1a-a7b0-adb698db75b8 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.733583] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-97befb5b-1df0-4d1a-a7b0-adb698db75b8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.733628] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-97befb5b-1df0-4d1a-a7b0-adb698db75b8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.733883] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-97befb5b-1df0-4d1a-a7b0-adb698db75b8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.733971] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97befb5b-1df0-4d1a-a7b0-adb698db75b8',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.901666] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19062702-bd29-4477-a732-5169f347b4da in Status: SUCCESS [ 1065.901666] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.901982] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.902116] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.903340] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.903340] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.903340] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.903340] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.903340] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.903340] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.129455] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3507e503-4abd-47ec-8347-82fc9e691881',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.237923] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 97befb5b-1df0-4d1a-a7b0-adb698db75b8 [ 1066.238241] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.238422] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.238489] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.238971] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.238971] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.239091] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:97befb5b-1df0-4d1a-a7b0-adb698db75b8 already deleted. [ 1066.240190] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-97befb5b-1df0-4d1a-a7b0-adb698db75b8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.382174] env[70392]: INFO networking_nsxv3.common.synchronization [None req-30bff370-5d2c-4e74-869a-aa64157c30cc tempest-AttachInterfacesTestJSON-2046649887 tempest-AttachInterfacesTestJSON-2046649887-project-member] Enqueued Resource ID: 3507e503-4abd-47ec-8347-82fc9e691881 with Priority: HIGHEST for action security_group_members [ 1066.382580] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3507e503-4abd-47ec-8347-82fc9e691881 with Priority: HIGHEST for action security_group_members [ 1066.383057] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-3507e503-4abd-47ec-8347-82fc9e691881 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.383408] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.405910] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.633378] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.633378] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.633378] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.633789] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.633789] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.633789] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3507e503-4abd-47ec-8347-82fc9e691881 is going to be updated. [ 1066.674179] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.674179] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.674179] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.674179] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.674179] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.681924] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3507e503-4abd-47ec-8347-82fc9e691881 in Status: IN_PROGRESS for 2s [ 1066.870982] env[70392]: INFO networking_nsxv3.common.synchronization [None req-7b4be40c-bb08-40bd-9984-2a7452a4c8a4 tempest-ServersV294TestFqdnHostnames-287335487 tempest-ServersV294TestFqdnHostnames-287335487-project-member] Enqueued Resource ID: ad5e0335-03f5-413e-88dc-5138f0daa778 with Priority: HIGHEST for action security_group_rules [ 1066.871557] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad5e0335-03f5-413e-88dc-5138f0daa778 with Priority: HIGHEST for action security_group_rules [ 1066.871874] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad5e0335-03f5-413e-88dc-5138f0daa778 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.872256] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad5e0335-03f5-413e-88dc-5138f0daa778" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.872367] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad5e0335-03f5-413e-88dc-5138f0daa778" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.872701] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad5e0335-03f5-413e-88dc-5138f0daa778" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.872751] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad5e0335-03f5-413e-88dc-5138f0daa778',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.908568] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.991569] env[70392]: INFO networking_nsxv3.common.synchronization [None req-04dfb28d-35a5-40dc-8fdc-f33b476a8f66 tempest-ServersV294TestFqdnHostnames-287335487 tempest-ServersV294TestFqdnHostnames-287335487-project-member] Enqueued Resource ID: ad5e0335-03f5-413e-88dc-5138f0daa778 with Priority: HIGHEST for action security_group_rules [ 1066.992441] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad5e0335-03f5-413e-88dc-5138f0daa778 with Priority: HIGHEST for action security_group_rules [ 1066.992803] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad5e0335-03f5-413e-88dc-5138f0daa778 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.992946] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad5e0335-03f5-413e-88dc-5138f0daa778" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.218014] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fcc3c75c-0cae-4c7c-8f32-6c948e76880d in Status: SUCCESS [ 1067.218403] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fcc3c75c-0cae-4c7c-8f32-6c948e76880d deletion is rescheduled due to dependency. [ 1067.218403] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fcc3c75c-0cae-4c7c-8f32-6c948e76880d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.396417] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.396583] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.397156] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.397156] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.397156] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.397156] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad5e0335-03f5-413e-88dc-5138f0daa778 already deleted. [ 1067.397156] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad5e0335-03f5-413e-88dc-5138f0daa778" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.398937] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad5e0335-03f5-413e-88dc-5138f0daa778" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.398937] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad5e0335-03f5-413e-88dc-5138f0daa778" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.398937] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad5e0335-03f5-413e-88dc-5138f0daa778',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.410932] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.411198] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.411198] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.411382] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.411476] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.411579] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19062702-bd29-4477-a732-5169f347b4da is going to be updated. [ 1067.450082] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.450650] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.450650] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.450650] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.450650] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.462887] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19062702-bd29-4477-a732-5169f347b4da in Status: IN_PROGRESS for 2s [ 1067.935068] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.938140] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.938318] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.940823] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.940823] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.940823] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad5e0335-03f5-413e-88dc-5138f0daa778 already deleted. [ 1067.940823] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad5e0335-03f5-413e-88dc-5138f0daa778" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.668578] env[70392]: INFO networking_nsxv3.common.synchronization [None req-9e457798-c343-44ab-af5d-0b98d7965b68 None None] Enqueued Resource ID: a691ae75-671b-4d9f-9fd2-187036b32e39 with Priority: HIGHEST for action port [ 1068.669178] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a691ae75-671b-4d9f-9fd2-187036b32e39 with Priority: HIGHEST for action port [ 1068.669737] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-a691ae75-671b-4d9f-9fd2-187036b32e39 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.669737] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a691ae75-671b-4d9f-9fd2-187036b32e39" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.669737] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a691ae75-671b-4d9f-9fd2-187036b32e39" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.670148] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a691ae75-671b-4d9f-9fd2-187036b32e39" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.670148] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a691ae75-671b-4d9f-9fd2-187036b32e39',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.691527] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3507e503-4abd-47ec-8347-82fc9e691881 in Status: SUCCESS [ 1068.691808] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.691983] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.692183] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.692367] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.692500] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.692718] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.692834] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.692834] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.692896] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3507e503-4abd-47ec-8347-82fc9e691881',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.172629] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a691ae75-671b-4d9f-9fd2-187036b32e39 [ 1069.172896] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.173126] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.173126] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.173313] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.173403] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.173503] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a691ae75-671b-4d9f-9fd2-187036b32e39 already deleted. [ 1069.173585] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a691ae75-671b-4d9f-9fd2-187036b32e39" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.196929] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.197169] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.197301] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.197574] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.198368] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.198368] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.198368] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.198368] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.198580] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.198580] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.198655] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3507e503-4abd-47ec-8347-82fc9e691881 is going to be updated. [ 1069.237915] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.238620] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.238620] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.238620] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.238620] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.254140] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3507e503-4abd-47ec-8347-82fc9e691881 in Status: IN_PROGRESS for 2s [ 1069.474489] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19062702-bd29-4477-a732-5169f347b4da in Status: SUCCESS [ 1069.474726] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.474906] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.475646] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.475646] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.475646] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.475646] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.475872] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.475872] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.475872] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.476177] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.879974] env[70392]: INFO networking_nsxv3.common.synchronization [req-dc453c1a-1138-44ee-9c5a-8957e7d30379 req-d5509d13-498a-4a7c-9642-7d870eaa4816 tempest-DeleteServersTestJSON-1676313022 tempest-DeleteServersTestJSON-1676313022-project-member] Enqueued Resource ID: ce79170a-31ce-429e-8e08-a911557872f4 with Priority: HIGHEST for action security_group_members [ 1069.880526] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce79170a-31ce-429e-8e08-a911557872f4 with Priority: HIGHEST for action security_group_members [ 1069.880852] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce79170a-31ce-429e-8e08-a911557872f4 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.880977] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.883434] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.883434] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.883434] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.883434] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.883434] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.883434] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.883434] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.883434] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce79170a-31ce-429e-8e08-a911557872f4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.980265] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-19062702-bd29-4477-a732-5169f347b4da taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.980265] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.980265] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.980532] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.980752] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.985161] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.985277] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.985537] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.985636] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.985734] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.985919] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-19062702-bd29-4477-a732-5169f347b4da taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.986034] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.986225] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.986284] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.986391] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.986481] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.986537] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.987107] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.987276] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.987521] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.987626] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.385719] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.386055] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.386055] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.386150] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.386565] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.386565] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.386565] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.386804] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.386804] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.386900] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.386963] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce79170a-31ce-429e-8e08-a911557872f4 is going to be updated. [ 1070.434063] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.434063] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.434063] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.434063] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.434063] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.440023] env[70392]: INFO networking_nsxv3.common.synchronization [req-ca9d120e-b45f-4785-bcf4-7688451bfacc req-355a1694-27a3-4ea3-9a2b-f1027be257e5 tempest-AttachInterfacesTestJSON-2046649887 tempest-AttachInterfacesTestJSON-2046649887-project-member] Enqueued Resource ID: 40ebe9d4-d512-4967-99a6-0a7cf11dc1cd with Priority: HIGHEST for action security_group_members [ 1070.440023] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40ebe9d4-d512-4967-99a6-0a7cf11dc1cd with Priority: HIGHEST for action security_group_members [ 1070.442143] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-40ebe9d4-d512-4967-99a6-0a7cf11dc1cd taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.442143] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40ebe9d4-d512-4967-99a6-0a7cf11dc1cd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.442143] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40ebe9d4-d512-4967-99a6-0a7cf11dc1cd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.442143] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40ebe9d4-d512-4967-99a6-0a7cf11dc1cd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.442143] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.442143] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.442143] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.442143] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.442143] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.442143] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40ebe9d4-d512-4967-99a6-0a7cf11dc1cd',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.445222] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce79170a-31ce-429e-8e08-a911557872f4 in Status: IN_PROGRESS for 2s [ 1070.491318] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 19062702-bd29-4477-a732-5169f347b4da: rpc.has_security_group_logging(os_id): False [ 1070.520197] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.520444] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.520524] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.520785] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.520884] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.521574] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.521574] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.521574] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.521574] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.521574] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.521916] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.521916] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.521916] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.522100] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.522189] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.522396] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.522518] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.522580] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.522773] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.522851] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.522941] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 19062702-bd29-4477-a732-5169f347b4da is going to be updated. [ 1070.606714] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.606714] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.606714] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.606714] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.606714] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.620885] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 19062702-bd29-4477-a732-5169f347b4da in Status: IN_PROGRESS for 2s [ 1070.948411] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.948411] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.948560] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.948975] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.975382] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.975382] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.975382] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.975382] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.975382] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.975382] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.975382] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40ebe9d4-d512-4967-99a6-0a7cf11dc1cd is going to be updated. [ 1071.004391] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.004659] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.004659] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.004837] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.004984] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.014783] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40ebe9d4-d512-4967-99a6-0a7cf11dc1cd in Status: IN_PROGRESS for 2s [ 1071.268823] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3507e503-4abd-47ec-8347-82fc9e691881 in Status: SUCCESS [ 1071.268823] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3507e503-4abd-47ec-8347-82fc9e691881 deletion is rescheduled due to dependency. [ 1071.268823] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.077210] env[70392]: INFO networking_nsxv3.common.synchronization [req-20e172d6-63bc-4f03-a54f-a52e66fb182d req-e1bbb738-d7a8-4689-9a18-38fab613b631 tempest-AttachVolumeShelveTestJSON-1019030511 tempest-AttachVolumeShelveTestJSON-1019030511-project-member] Enqueued Resource ID: ee8b641c-b2f7-4b94-85bb-98a31dba1604 with Priority: HIGHEST for action security_group_members [ 1072.077769] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee8b641c-b2f7-4b94-85bb-98a31dba1604 with Priority: HIGHEST for action security_group_members [ 1072.078094] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee8b641c-b2f7-4b94-85bb-98a31dba1604 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.078215] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee8b641c-b2f7-4b94-85bb-98a31dba1604" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.078284] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee8b641c-b2f7-4b94-85bb-98a31dba1604" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.078554] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee8b641c-b2f7-4b94-85bb-98a31dba1604" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.079162] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.079162] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.079309] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.079357] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.079441] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.079531] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee8b641c-b2f7-4b94-85bb-98a31dba1604',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.456364] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce79170a-31ce-429e-8e08-a911557872f4 in Status: SUCCESS [ 1072.456560] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce79170a-31ce-429e-8e08-a911557872f4 deletion is rescheduled due to dependency. [ 1072.456696] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.515211] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-109 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.515602] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-109" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.515819] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-109" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.516485] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-109" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.518277] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.518491] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.518635] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.518897] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.519079] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.519310] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1072.519443] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1072.519614] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1072.519751] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1072.519873] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1072.520323] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1072.520323] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1072.546346] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1072.546514] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1072.546749] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1072.546882] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-109" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.547167] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-4a451501-d220-44ab-ae11-9eead0f8d216 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.547340] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-4a451501-d220-44ab-ae11-9eead0f8d216" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.547470] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-4a451501-d220-44ab-ae11-9eead0f8d216" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.547893] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-4a451501-d220-44ab-ae11-9eead0f8d216" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.548105] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a451501-d220-44ab-ae11-9eead0f8d216',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.582431] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.584319] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.584319] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.584319] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.584319] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.584319] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.584319] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.584319] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.584319] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.584319] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.584319] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee8b641c-b2f7-4b94-85bb-98a31dba1604 already deleted. [ 1072.584319] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee8b641c-b2f7-4b94-85bb-98a31dba1604" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.635501] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 19062702-bd29-4477-a732-5169f347b4da in Status: SUCCESS [ 1072.635501] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.027659] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40ebe9d4-d512-4967-99a6-0a7cf11dc1cd in Status: SUCCESS [ 1073.027659] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40ebe9d4-d512-4967-99a6-0a7cf11dc1cd deletion is rescheduled due to dependency. [ 1073.027659] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40ebe9d4-d512-4967-99a6-0a7cf11dc1cd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.051539] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.051803] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.052119] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.052485] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.052708] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.052893] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 4a451501-d220-44ab-ae11-9eead0f8d216 not found, creating... [ 1073.053246] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.053441] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.053572] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.053963] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.054150] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.054592] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.054751] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.054894] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.055147] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.055331] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.055492] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 4a451501-d220-44ab-ae11-9eead0f8d216 is going to be created. [ 1073.080151] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.080523] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.080718] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.081232] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.081323] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.081552] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-4a451501-d220-44ab-ae11-9eead0f8d216" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.189805] env[70392]: INFO networking_nsxv3.common.synchronization [None req-31a12451-0617-4129-b6e5-ff12c5c61ac9 None None] Enqueued Resource ID: 694ee528-39a1-46ca-b788-017ce6aece1d with Priority: HIGHEST for action port [ 1073.190123] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 694ee528-39a1-46ca-b788-017ce6aece1d with Priority: HIGHEST for action port [ 1073.190830] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-694ee528-39a1-46ca-b788-017ce6aece1d taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.191171] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-694ee528-39a1-46ca-b788-017ce6aece1d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.191171] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-694ee528-39a1-46ca-b788-017ce6aece1d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.191690] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-694ee528-39a1-46ca-b788-017ce6aece1d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.191690] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('694ee528-39a1-46ca-b788-017ce6aece1d',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.697867] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 694ee528-39a1-46ca-b788-017ce6aece1d [ 1073.698114] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.698260] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.698336] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.698569] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.698639] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.698732] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:694ee528-39a1-46ca-b788-017ce6aece1d already deleted. [ 1073.698808] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-694ee528-39a1-46ca-b788-017ce6aece1d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.894379] env[70392]: INFO networking_nsxv3.common.synchronization [req-20e172d6-63bc-4f03-a54f-a52e66fb182d req-ddfdef45-bc8c-442a-ae02-1114ae7f4e03 service nova] Enqueued Resource ID: ee8b641c-b2f7-4b94-85bb-98a31dba1604 with Priority: HIGHEST for action security_group_rules [ 1073.894725] env[70392]: INFO networking_nsxv3.common.synchronization [req-20e172d6-63bc-4f03-a54f-a52e66fb182d req-ddfdef45-bc8c-442a-ae02-1114ae7f4e03 service nova] Enqueued Resource ID: ee8b641c-b2f7-4b94-85bb-98a31dba1604 with Priority: HIGHEST for action security_group_members [ 1073.895074] env[70392]: INFO networking_nsxv3.common.synchronization [req-20e172d6-63bc-4f03-a54f-a52e66fb182d req-ddfdef45-bc8c-442a-ae02-1114ae7f4e03 service nova] Enqueued Resource ID: 4a451501-d220-44ab-ae11-9eead0f8d216 with Priority: HIGHEST for action port [ 1073.896784] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee8b641c-b2f7-4b94-85bb-98a31dba1604 with Priority: HIGHEST for action security_group_rules [ 1073.896784] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee8b641c-b2f7-4b94-85bb-98a31dba1604 with Priority: HIGHEST for action security_group_members [ 1073.896784] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a451501-d220-44ab-ae11-9eead0f8d216 with Priority: HIGHEST for action port [ 1073.896784] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee8b641c-b2f7-4b94-85bb-98a31dba1604 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.897160] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee8b641c-b2f7-4b94-85bb-98a31dba1604" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.897160] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee8b641c-b2f7-4b94-85bb-98a31dba1604" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.897160] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee8b641c-b2f7-4b94-85bb-98a31dba1604" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.897287] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee8b641c-b2f7-4b94-85bb-98a31dba1604',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.898184] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee8b641c-b2f7-4b94-85bb-98a31dba1604 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.898315] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee8b641c-b2f7-4b94-85bb-98a31dba1604" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.898359] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee8b641c-b2f7-4b94-85bb-98a31dba1604" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.900852] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee8b641c-b2f7-4b94-85bb-98a31dba1604" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.900852] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.900852] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.900852] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.900852] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.900852] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.900852] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee8b641c-b2f7-4b94-85bb-98a31dba1604',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.900852] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a451501-d220-44ab-ae11-9eead0f8d216 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.903556] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a451501-d220-44ab-ae11-9eead0f8d216" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.906454] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a451501-d220-44ab-ae11-9eead0f8d216" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.906454] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a451501-d220-44ab-ae11-9eead0f8d216" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.906454] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a451501-d220-44ab-ae11-9eead0f8d216',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.406945] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee8b641c-b2f7-4b94-85bb-98a31dba1604 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.406945] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee8b641c-b2f7-4b94-85bb-98a31dba1604" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.407345] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ee8b641c-b2f7-4b94-85bb-98a31dba1604',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.408923] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4a451501-d220-44ab-ae11-9eead0f8d216 with status ACTIVE [ 1074.409355] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.409460] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.409610] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.409900] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.410404] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.410404] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.410404] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.410968] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.410968] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.410968] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.411289] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.411455] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.411455] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.412139] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.412592] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.413449] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4a451501-d220-44ab-ae11-9eead0f8d216 is going to be updated. [ 1074.443207] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.444035] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.444196] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.444376] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.444774] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.444878] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a451501-d220-44ab-ae11-9eead0f8d216" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.909262] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ee8b641c-b2f7-4b94-85bb-98a31dba1604',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.415021] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.415021] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.415021] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.415021] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.415021] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.415021] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee8b641c-b2f7-4b94-85bb-98a31dba1604 is going to be created. [ 1075.439382] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.439382] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.439382] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.439382] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.439382] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.450700] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee8b641c-b2f7-4b94-85bb-98a31dba1604 in Status: UNINITIALIZED for 2s [ 1076.591902] env[70392]: INFO networking_nsxv3.common.synchronization [req-c7503b9a-a279-4656-b252-3b7a08497e58 req-43747d62-7593-4fdd-b41b-480b1454a53b tempest-ServersAdminTestJSON-721710769 tempest-ServersAdminTestJSON-721710769-project-member] Enqueued Resource ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 with Priority: HIGHEST for action security_group_members [ 1076.592601] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 with Priority: HIGHEST for action security_group_members [ 1076.592974] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-f54639a3-c11e-4833-b47a-e0b477c46dd5 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.593160] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.593160] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.593326] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.593501] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.593603] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.593667] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.594202] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.594202] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.594202] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f54639a3-c11e-4833-b47a-e0b477c46dd5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.095971] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f54639a3-c11e-4833-b47a-e0b477c46dd5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.327248] env[70392]: INFO networking_nsxv3.common.synchronization [None req-cbad8e18-97b4-46b6-a31e-b01203c95d97 tempest-ServerActionsTestOtherA-1411478130 tempest-ServerActionsTestOtherA-1411478130-project-member] Enqueued Resource ID: bb62eb06-eeb8-448e-a256-ef5cfef1b811 with Priority: HIGHEST for action security_group_rules [ 1077.327820] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb62eb06-eeb8-448e-a256-ef5cfef1b811 with Priority: HIGHEST for action security_group_rules [ 1077.329167] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bb62eb06-eeb8-448e-a256-ef5cfef1b811 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.329167] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bb62eb06-eeb8-448e-a256-ef5cfef1b811" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.333143] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bb62eb06-eeb8-448e-a256-ef5cfef1b811" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.333488] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bb62eb06-eeb8-448e-a256-ef5cfef1b811" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.333590] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bb62eb06-eeb8-448e-a256-ef5cfef1b811',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.463166] env[70392]: INFO networking_nsxv3.common.synchronization [None req-6a841b08-298f-4917-a520-b6aea2961401 tempest-ServerActionsTestOtherA-1411478130 tempest-ServerActionsTestOtherA-1411478130-project-member] Enqueued Resource ID: bb62eb06-eeb8-448e-a256-ef5cfef1b811 with Priority: HIGHEST for action security_group_rules [ 1077.463166] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb62eb06-eeb8-448e-a256-ef5cfef1b811 with Priority: HIGHEST for action security_group_rules [ 1077.463682] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bb62eb06-eeb8-448e-a256-ef5cfef1b811 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.463682] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bb62eb06-eeb8-448e-a256-ef5cfef1b811" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.465842] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee8b641c-b2f7-4b94-85bb-98a31dba1604 in Status: SUCCESS [ 1077.465842] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee8b641c-b2f7-4b94-85bb-98a31dba1604" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.468131] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee8b641c-b2f7-4b94-85bb-98a31dba1604" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.468131] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee8b641c-b2f7-4b94-85bb-98a31dba1604" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.468131] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.468131] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.468131] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.468131] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.468131] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.468131] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee8b641c-b2f7-4b94-85bb-98a31dba1604" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.468131] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ee8b641c-b2f7-4b94-85bb-98a31dba1604',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.598863] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f54639a3-c11e-4833-b47a-e0b477c46dd5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.857340] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.857340] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.857340] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.857340] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.857340] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.857340] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bb62eb06-eeb8-448e-a256-ef5cfef1b811 already deleted. [ 1077.857340] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bb62eb06-eeb8-448e-a256-ef5cfef1b811" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.860443] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bb62eb06-eeb8-448e-a256-ef5cfef1b811" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.860443] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bb62eb06-eeb8-448e-a256-ef5cfef1b811" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.860443] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bb62eb06-eeb8-448e-a256-ef5cfef1b811',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.971691] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ee8b641c-b2f7-4b94-85bb-98a31dba1604',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.102120] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.102297] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.102367] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.102643] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.102749] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.102855] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 is going to be updated. [ 1078.135416] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.135416] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.135416] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.135794] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.136025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.147533] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 in Status: IN_PROGRESS for 2s [ 1078.385366] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.385479] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.385536] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.385763] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.385880] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.385982] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bb62eb06-eeb8-448e-a256-ef5cfef1b811 already deleted. [ 1078.386103] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bb62eb06-eeb8-448e-a256-ef5cfef1b811" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.475257] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ee8b641c-b2f7-4b94-85bb-98a31dba1604: rpc.has_security_group_logging(os_id): False [ 1078.496211] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.496366] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.496436] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.496675] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.496775] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.497041] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.497146] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.497194] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.497356] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.498017] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.498017] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee8b641c-b2f7-4b94-85bb-98a31dba1604 is going to be created. [ 1078.571097] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.571097] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.571097] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.571097] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.571097] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.586618] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee8b641c-b2f7-4b94-85bb-98a31dba1604 in Status: IN_PROGRESS for 2s [ 1078.779414] env[70392]: INFO networking_nsxv3.common.synchronization [req-a6f08055-9641-4f8c-a061-3d44a13eec09 req-cb568174-c928-4aa8-b4fc-159aa212a1d4 tempest-ServersTestJSON-507292717 tempest-ServersTestJSON-507292717-project-member] Enqueued Resource ID: 19062702-bd29-4477-a732-5169f347b4da with Priority: HIGHEST for action security_group_members [ 1078.779414] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19062702-bd29-4477-a732-5169f347b4da with Priority: HIGHEST for action security_group_members [ 1078.779414] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-19062702-bd29-4477-a732-5169f347b4da taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.779414] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.780564] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.780809] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.780982] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.781102] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.781166] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.781909] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.782051] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.782110] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.285709] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.586399] env[70392]: INFO networking_nsxv3.common.synchronization [req-01c0f841-398c-44e7-b039-a32456ea476c req-f7929ed8-9d27-4534-8ab3-ab4bcefd51fe tempest-ServerExternalEventsTest-403879177 tempest-ServerExternalEventsTest-403879177-project-member] Enqueued Resource ID: f8c45013-4f96-4753-81c1-dc9e755bf45a with Priority: HIGHEST for action security_group_members [ 1079.586813] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8c45013-4f96-4753-81c1-dc9e755bf45a with Priority: HIGHEST for action security_group_members [ 1079.587140] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8c45013-4f96-4753-81c1-dc9e755bf45a taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.587274] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8c45013-4f96-4753-81c1-dc9e755bf45a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.587336] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8c45013-4f96-4753-81c1-dc9e755bf45a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.587567] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8c45013-4f96-4753-81c1-dc9e755bf45a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.587722] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.587831] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.587906] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.588024] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.588110] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.588195] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8c45013-4f96-4753-81c1-dc9e755bf45a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.788400] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.969533] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-325 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.969533] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-325" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.970046] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-325" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.970474] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-325" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.971041] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.971312] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.971495] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.971739] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.971893] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.972181] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1079.972247] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1079.972390] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1079.972508] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1079.972671] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1079.972787] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1079.972922] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1079.992319] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1079.992551] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1079.992729] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1079.993016] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-325" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.993414] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-ba8b7189-c991-4428-ad6b-9d46d245a820 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.993653] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-ba8b7189-c991-4428-ad6b-9d46d245a820" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.993846] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-ba8b7189-c991-4428-ad6b-9d46d245a820" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.994242] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-ba8b7189-c991-4428-ad6b-9d46d245a820" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.994403] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba8b7189-c991-4428-ad6b-9d46d245a820',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.091985] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.092154] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.092226] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.092530] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.092530] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.092778] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.092872] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.092908] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.093074] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.093142] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.093191] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8c45013-4f96-4753-81c1-dc9e755bf45a already deleted. [ 1080.093270] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8c45013-4f96-4753-81c1-dc9e755bf45a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.158815] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 in Status: SUCCESS [ 1080.159084] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.291019] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.291215] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.291282] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.291767] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.291767] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.291767] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19062702-bd29-4477-a732-5169f347b4da is going to be updated. [ 1080.325376] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.325517] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.325580] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.326085] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.326360] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.336765] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19062702-bd29-4477-a732-5169f347b4da in Status: IN_PROGRESS for 2s [ 1080.496794] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.497098] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.497268] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.497551] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.497712] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.497874] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port ba8b7189-c991-4428-ad6b-9d46d245a820 not found, creating... [ 1080.498153] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.498322] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.498443] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.498666] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.498809] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.499138] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.499306] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.499413] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.499633] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.499762] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.499908] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: ba8b7189-c991-4428-ad6b-9d46d245a820 is going to be created. [ 1080.552807] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.553114] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.553254] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.553556] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.553812] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.554077] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-ba8b7189-c991-4428-ad6b-9d46d245a820" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.601030] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee8b641c-b2f7-4b94-85bb-98a31dba1604 in Status: SUCCESS [ 1080.601030] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee8b641c-b2f7-4b94-85bb-98a31dba1604" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.325387] env[70392]: INFO networking_nsxv3.common.synchronization [req-01c0f841-398c-44e7-b039-a32456ea476c req-f92ce12e-8fbe-4e3f-8a7b-77753bd7c302 service nova] Enqueued Resource ID: f8c45013-4f96-4753-81c1-dc9e755bf45a with Priority: HIGHEST for action security_group_rules [ 1081.325725] env[70392]: INFO networking_nsxv3.common.synchronization [req-01c0f841-398c-44e7-b039-a32456ea476c req-f92ce12e-8fbe-4e3f-8a7b-77753bd7c302 service nova] Enqueued Resource ID: f8c45013-4f96-4753-81c1-dc9e755bf45a with Priority: HIGHEST for action security_group_members [ 1081.325725] env[70392]: INFO networking_nsxv3.common.synchronization [req-01c0f841-398c-44e7-b039-a32456ea476c req-f92ce12e-8fbe-4e3f-8a7b-77753bd7c302 service nova] Enqueued Resource ID: ba8b7189-c991-4428-ad6b-9d46d245a820 with Priority: HIGHEST for action port [ 1081.325997] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8c45013-4f96-4753-81c1-dc9e755bf45a with Priority: HIGHEST for action security_group_rules [ 1081.326102] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8c45013-4f96-4753-81c1-dc9e755bf45a with Priority: HIGHEST for action security_group_members [ 1081.326193] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba8b7189-c991-4428-ad6b-9d46d245a820 with Priority: HIGHEST for action port [ 1081.328252] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f8c45013-4f96-4753-81c1-dc9e755bf45a taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.328434] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f8c45013-4f96-4753-81c1-dc9e755bf45a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.328582] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f8c45013-4f96-4753-81c1-dc9e755bf45a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.328890] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f8c45013-4f96-4753-81c1-dc9e755bf45a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.329042] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f8c45013-4f96-4753-81c1-dc9e755bf45a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.331293] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8c45013-4f96-4753-81c1-dc9e755bf45a taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.332232] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8c45013-4f96-4753-81c1-dc9e755bf45a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.332315] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8c45013-4f96-4753-81c1-dc9e755bf45a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.332563] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8c45013-4f96-4753-81c1-dc9e755bf45a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.332695] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.332826] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.332871] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.332999] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.333100] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.333192] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8c45013-4f96-4753-81c1-dc9e755bf45a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.334025] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-ba8b7189-c991-4428-ad6b-9d46d245a820 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.334133] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ba8b7189-c991-4428-ad6b-9d46d245a820" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.334201] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ba8b7189-c991-4428-ad6b-9d46d245a820" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.334355] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ba8b7189-c991-4428-ad6b-9d46d245a820" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.334432] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba8b7189-c991-4428-ad6b-9d46d245a820',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.832751] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8c45013-4f96-4753-81c1-dc9e755bf45a taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.832751] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8c45013-4f96-4753-81c1-dc9e755bf45a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.838295] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f8c45013-4f96-4753-81c1-dc9e755bf45a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.838295] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ba8b7189-c991-4428-ad6b-9d46d245a820 with status ACTIVE [ 1081.838295] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.838295] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.838295] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.838295] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.838295] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.838295] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.838295] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.839250] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.839250] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.839250] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.839250] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.839250] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.839250] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.843303] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.843500] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.843500] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ba8b7189-c991-4428-ad6b-9d46d245a820 is going to be updated. [ 1081.868083] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.868083] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.868083] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.868083] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.868083] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.868083] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ba8b7189-c991-4428-ad6b-9d46d245a820" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.345771] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f8c45013-4f96-4753-81c1-dc9e755bf45a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.349371] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19062702-bd29-4477-a732-5169f347b4da in Status: SUCCESS [ 1082.349371] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.848267] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.848470] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.848540] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.849650] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.849791] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.849928] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8c45013-4f96-4753-81c1-dc9e755bf45a is going to be created. [ 1082.878279] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.878279] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.878279] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.878279] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.878279] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.888952] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8c45013-4f96-4753-81c1-dc9e755bf45a in Status: UNINITIALIZED for 2s [ 1084.194975] env[70392]: INFO networking_nsxv3.common.synchronization [req-3c8e0dca-4740-4f7a-9ae3-e32e6120f521 req-77fcaabf-b182-4790-bd1b-fc25b8416d44 tempest-ListServerFiltersTestJSON-50551211 tempest-ListServerFiltersTestJSON-50551211-project-member] Enqueued Resource ID: 4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 with Priority: HIGHEST for action security_group_members [ 1084.195316] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 with Priority: HIGHEST for action security_group_members [ 1084.195593] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.195675] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.195749] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.196045] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.196161] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.196306] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.196363] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.196473] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.196533] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.196628] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f7f8865-743f-4e67-8bf2-9a21ed1eaac4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.699654] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4f7f8865-743f-4e67-8bf2-9a21ed1eaac4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.902237] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8c45013-4f96-4753-81c1-dc9e755bf45a in Status: SUCCESS [ 1084.902424] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8c45013-4f96-4753-81c1-dc9e755bf45a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.902633] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8c45013-4f96-4753-81c1-dc9e755bf45a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.903368] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8c45013-4f96-4753-81c1-dc9e755bf45a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.903368] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.903368] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.903368] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.903368] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.903620] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.903620] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8c45013-4f96-4753-81c1-dc9e755bf45a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.903620] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f8c45013-4f96-4753-81c1-dc9e755bf45a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.201698] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4f7f8865-743f-4e67-8bf2-9a21ed1eaac4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.405943] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8c45013-4f96-4753-81c1-dc9e755bf45a taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.406160] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8c45013-4f96-4753-81c1-dc9e755bf45a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.406315] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8c45013-4f96-4753-81c1-dc9e755bf45a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.406505] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8c45013-4f96-4753-81c1-dc9e755bf45a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.407479] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.407479] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.407479] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.407479] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.407479] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.407479] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8c45013-4f96-4753-81c1-dc9e755bf45a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.407479] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8c45013-4f96-4753-81c1-dc9e755bf45a taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.407479] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8c45013-4f96-4753-81c1-dc9e755bf45a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.408121] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8c45013-4f96-4753-81c1-dc9e755bf45a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.408121] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8c45013-4f96-4753-81c1-dc9e755bf45a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.408121] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.408121] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.408121] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.408121] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.408462] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.408462] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8c45013-4f96-4753-81c1-dc9e755bf45a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.408462] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f8c45013-4f96-4753-81c1-dc9e755bf45a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.703824] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.703981] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.704072] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.704291] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.704383] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.704486] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 is going to be updated. [ 1085.746320] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.746320] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.746320] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.746320] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.746618] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.756185] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 in Status: IN_PROGRESS for 2s [ 1085.911797] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f8c45013-4f96-4753-81c1-dc9e755bf45a: rpc.has_security_group_logging(os_id): False [ 1085.939869] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.939869] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.939869] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.940169] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.940169] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.940399] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.940536] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.940622] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.940830] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.940941] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.941214] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.941354] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.941492] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.941630] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.941741] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.941964] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.942108] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.942194] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.942402] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.942475] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.942664] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f8c45013-4f96-4753-81c1-dc9e755bf45a is going to be created. [ 1086.027151] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.027385] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.027385] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.027579] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.027757] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.045922] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8c45013-4f96-4753-81c1-dc9e755bf45a in Status: IN_PROGRESS for 2s [ 1087.771030] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 in Status: SUCCESS [ 1087.771301] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.068540] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8c45013-4f96-4753-81c1-dc9e755bf45a in Status: SUCCESS [ 1088.069555] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f8c45013-4f96-4753-81c1-dc9e755bf45a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.196664] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1089.196980] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1089.932292] env[70392]: INFO networking_nsxv3.common.synchronization [req-25103dac-ddb2-4c61-bf45-72ff641f81de req-8ee88ba9-1c9a-48e0-a7fd-d7e2fa434ed7 tempest-ServersNegativeTestJSON-1387658603 tempest-ServersNegativeTestJSON-1387658603-project-member] Enqueued Resource ID: c3e59ae3-629d-4146-9bee-ef9808a03841 with Priority: HIGHEST for action security_group_members [ 1089.932859] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3e59ae3-629d-4146-9bee-ef9808a03841 with Priority: HIGHEST for action security_group_members [ 1089.933337] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3e59ae3-629d-4146-9bee-ef9808a03841 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.933460] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.933531] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.933721] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.934032] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.934128] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.934128] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.934266] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.934353] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.934445] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c3e59ae3-629d-4146-9bee-ef9808a03841',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.386557] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-657 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.386902] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-657" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.386902] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-657" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.387822] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-657" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.387822] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.387822] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.387822] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.388162] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.388162] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.388398] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1090.388490] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1090.388609] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1090.389284] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1090.389284] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1090.389284] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1090.389284] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1090.410497] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1090.410686] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1090.410823] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1090.411034] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-657" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.411375] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-74854088-34b0-4242-82aa-4fb880c9eb02 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.411604] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-74854088-34b0-4242-82aa-4fb880c9eb02" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.411753] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-74854088-34b0-4242-82aa-4fb880c9eb02" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.412098] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-74854088-34b0-4242-82aa-4fb880c9eb02" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.412246] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74854088-34b0-4242-82aa-4fb880c9eb02',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.438779] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c3e59ae3-629d-4146-9bee-ef9808a03841',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.915214] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.915518] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.915656] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.916013] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.916339] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.916380] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 74854088-34b0-4242-82aa-4fb880c9eb02 not found, creating... [ 1090.916624] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.917028] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.917028] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.917190] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.917287] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.917584] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.917743] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.917864] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.918133] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.918307] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.918458] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 74854088-34b0-4242-82aa-4fb880c9eb02 is going to be created. [ 1090.941286] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c3e59ae3-629d-4146-9bee-ef9808a03841',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.954082] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.954340] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.954487] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.954838] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.955217] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.955498] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-74854088-34b0-4242-82aa-4fb880c9eb02" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.977339] env[70392]: INFO networking_nsxv3.common.synchronization [req-b0e6f4f6-acac-409c-ac15-5dd2d11e0070 req-43d008f4-cf18-480a-aac5-e40f48fb8194 tempest-AttachVolumeNegativeTest-772339566 tempest-AttachVolumeNegativeTest-772339566-project-member] Enqueued Resource ID: 3b776bd0-c07d-4db7-beb4-bf0b0360a21c with Priority: HIGHEST for action security_group_members [ 1090.977833] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b776bd0-c07d-4db7-beb4-bf0b0360a21c with Priority: HIGHEST for action security_group_members [ 1090.978159] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b776bd0-c07d-4db7-beb4-bf0b0360a21c taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.978290] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b776bd0-c07d-4db7-beb4-bf0b0360a21c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.978364] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b776bd0-c07d-4db7-beb4-bf0b0360a21c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.978775] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b776bd0-c07d-4db7-beb4-bf0b0360a21c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.979772] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.981223] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.981303] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.981479] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.981565] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.981662] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3b776bd0-c07d-4db7-beb4-bf0b0360a21c',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.444104] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.444389] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.444389] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.444490] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.444538] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.444640] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3e59ae3-629d-4146-9bee-ef9808a03841 is going to be updated. [ 1091.484838] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.485116] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.485229] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.485575] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.492080] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.492316] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.492439] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.493123] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.493123] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.503393] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3e59ae3-629d-4146-9bee-ef9808a03841 in Status: IN_PROGRESS for 2s [ 1091.508600] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.509191] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.509383] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.509480] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.509712] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.509844] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.509981] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b776bd0-c07d-4db7-beb4-bf0b0360a21c is going to be updated. [ 1091.557274] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.557274] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.557274] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.557478] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.557478] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.572448] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b776bd0-c07d-4db7-beb4-bf0b0360a21c in Status: IN_PROGRESS for 2s [ 1091.739627] env[70392]: INFO networking_nsxv3.common.synchronization [req-25103dac-ddb2-4c61-bf45-72ff641f81de req-2f216198-b9f3-40e3-b294-06406ae85983 service nova] Enqueued Resource ID: c3e59ae3-629d-4146-9bee-ef9808a03841 with Priority: HIGHEST for action security_group_rules [ 1091.741102] env[70392]: INFO networking_nsxv3.common.synchronization [req-25103dac-ddb2-4c61-bf45-72ff641f81de req-2f216198-b9f3-40e3-b294-06406ae85983 service nova] Enqueued Resource ID: c3e59ae3-629d-4146-9bee-ef9808a03841 with Priority: HIGHEST for action security_group_members [ 1091.741102] env[70392]: INFO networking_nsxv3.common.synchronization [req-25103dac-ddb2-4c61-bf45-72ff641f81de req-2f216198-b9f3-40e3-b294-06406ae85983 service nova] Enqueued Resource ID: 74854088-34b0-4242-82aa-4fb880c9eb02 with Priority: HIGHEST for action port [ 1091.741102] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3e59ae3-629d-4146-9bee-ef9808a03841 with Priority: HIGHEST for action security_group_rules [ 1091.741102] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3e59ae3-629d-4146-9bee-ef9808a03841 with Priority: HIGHEST for action security_group_members [ 1091.741102] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74854088-34b0-4242-82aa-4fb880c9eb02 with Priority: HIGHEST for action port [ 1091.741354] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c3e59ae3-629d-4146-9bee-ef9808a03841 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.741354] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.741456] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.741570] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.741649] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c3e59ae3-629d-4146-9bee-ef9808a03841',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.742515] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3e59ae3-629d-4146-9bee-ef9808a03841 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.742600] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.742814] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-74854088-34b0-4242-82aa-4fb880c9eb02 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.742938] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-74854088-34b0-4242-82aa-4fb880c9eb02" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.743009] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-74854088-34b0-4242-82aa-4fb880c9eb02" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.743198] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-74854088-34b0-4242-82aa-4fb880c9eb02" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.743290] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74854088-34b0-4242-82aa-4fb880c9eb02',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.246351] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3e59ae3-629d-4146-9bee-ef9808a03841 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.246701] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.247100] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 74854088-34b0-4242-82aa-4fb880c9eb02 with status ACTIVE [ 1092.247398] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.247632] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.247789] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.250343] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.250575] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.250994] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.251287] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.251481] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.251857] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.253021] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.253021] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.253021] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.253021] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.253021] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.253021] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.253021] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 74854088-34b0-4242-82aa-4fb880c9eb02 is going to be updated. [ 1092.281216] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.281302] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.281372] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.281584] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.281728] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.281914] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-74854088-34b0-4242-82aa-4fb880c9eb02" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.625597] env[70392]: INFO networking_nsxv3.common.synchronization [req-a1839317-040b-4027-83ab-c03822afc8b6 req-dae89488-9004-4bb6-93eb-a0a8b0071749 tempest-ServersV294TestFqdnHostnames-287335487 tempest-ServersV294TestFqdnHostnames-287335487-project-member] Enqueued Resource ID: ad5e0335-03f5-413e-88dc-5138f0daa778 with Priority: HIGHEST for action security_group_members [ 1092.626324] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad5e0335-03f5-413e-88dc-5138f0daa778 with Priority: HIGHEST for action security_group_members [ 1092.627425] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad5e0335-03f5-413e-88dc-5138f0daa778 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.627648] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad5e0335-03f5-413e-88dc-5138f0daa778" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.627740] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad5e0335-03f5-413e-88dc-5138f0daa778" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.628756] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad5e0335-03f5-413e-88dc-5138f0daa778" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.628756] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.628756] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.628756] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.628756] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.629102] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.629102] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad5e0335-03f5-413e-88dc-5138f0daa778',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.132923] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.133125] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.133208] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.136395] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.136503] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.136751] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.136868] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.136937] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.137134] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.137228] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.137332] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad5e0335-03f5-413e-88dc-5138f0daa778 already deleted. [ 1093.137415] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad5e0335-03f5-413e-88dc-5138f0daa778" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.479262] env[70392]: INFO networking_nsxv3.common.synchronization [req-9a74473d-5d35-46ac-9549-ade1b5d432c7 req-b17fb456-5de3-4c9e-acf1-f2af9c5f786e tempest-ServerExternalEventsTest-403879177 tempest-ServerExternalEventsTest-403879177-project-member] Enqueued Resource ID: f8c45013-4f96-4753-81c1-dc9e755bf45a with Priority: HIGHEST for action security_group_members [ 1093.479829] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8c45013-4f96-4753-81c1-dc9e755bf45a with Priority: HIGHEST for action security_group_members [ 1093.480221] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8c45013-4f96-4753-81c1-dc9e755bf45a taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.480360] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8c45013-4f96-4753-81c1-dc9e755bf45a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.480444] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8c45013-4f96-4753-81c1-dc9e755bf45a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.480677] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8c45013-4f96-4753-81c1-dc9e755bf45a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.480856] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.480973] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.481060] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.481250] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.481377] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.481446] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8c45013-4f96-4753-81c1-dc9e755bf45a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.506384] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-251 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.506384] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-251" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.506565] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-251" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.506760] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-251" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.509603] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.509603] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.509603] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.509603] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.509603] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.509603] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1093.509603] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1093.509603] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1093.509603] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1093.509603] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1093.509603] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1093.510093] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1093.521480] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3e59ae3-629d-4146-9bee-ef9808a03841 in Status: SUCCESS [ 1093.521712] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.521867] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.522097] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.522284] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.522398] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.522460] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.522622] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.522788] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.522788] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c3e59ae3-629d-4146-9bee-ef9808a03841',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.534433] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1093.534433] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1093.534433] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1093.534433] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-251" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.534433] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-c78933f5-9fec-4217-94ed-483a36952363 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.534433] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-c78933f5-9fec-4217-94ed-483a36952363" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.534433] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-c78933f5-9fec-4217-94ed-483a36952363" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.534988] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-c78933f5-9fec-4217-94ed-483a36952363" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.534988] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c78933f5-9fec-4217-94ed-483a36952363',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.582129] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b776bd0-c07d-4db7-beb4-bf0b0360a21c in Status: SUCCESS [ 1093.582322] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b776bd0-c07d-4db7-beb4-bf0b0360a21c deletion is rescheduled due to dependency. [ 1093.582450] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b776bd0-c07d-4db7-beb4-bf0b0360a21c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.729331] env[70392]: INFO networking_nsxv3.common.synchronization [req-44f12e13-9a2a-41b7-aa96-e844b12a0087 req-29bb3e39-f2fa-4f82-a7fd-2bf3eae13f52 tempest-ServerRescueNegativeTestJSON-197938596 tempest-ServerRescueNegativeTestJSON-197938596-project-member] Enqueued Resource ID: eee84844-ea79-48de-9294-c53a759dc328 with Priority: HIGHEST for action security_group_members [ 1093.730649] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eee84844-ea79-48de-9294-c53a759dc328 with Priority: HIGHEST for action security_group_members [ 1093.730649] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-eee84844-ea79-48de-9294-c53a759dc328 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.730649] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.730649] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.730649] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.730987] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.730987] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.730987] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.731155] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.731155] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.732024] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eee84844-ea79-48de-9294-c53a759dc328',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.983676] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.983939] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.983995] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.984349] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.984501] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.984739] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.984835] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.984966] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.985182] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.985287] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.985399] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8c45013-4f96-4753-81c1-dc9e755bf45a is going to be updated. [ 1094.016754] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.016965] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.016965] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.017268] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.017408] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.025120] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c3e59ae3-629d-4146-9bee-ef9808a03841',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.035021] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8c45013-4f96-4753-81c1-dc9e755bf45a in Status: IN_PROGRESS for 2s [ 1094.037768] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.038020] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.038139] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.038421] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.038577] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.038734] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port c78933f5-9fec-4217-94ed-483a36952363 not found, creating... [ 1094.038988] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.039164] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.039302] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.039502] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.039643] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.040470] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.040470] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.040470] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.040470] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.040768] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.040768] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: c78933f5-9fec-4217-94ed-483a36952363 is going to be created. [ 1094.064035] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.064341] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.064532] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.065114] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.065609] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.066506] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-c78933f5-9fec-4217-94ed-483a36952363" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.233550] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eee84844-ea79-48de-9294-c53a759dc328',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.527594] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c3e59ae3-629d-4146-9bee-ef9808a03841',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.737487] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eee84844-ea79-48de-9294-c53a759dc328',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.870229] env[70392]: INFO networking_nsxv3.common.synchronization [req-a1839317-040b-4027-83ab-c03822afc8b6 req-3eeff0e8-2ffe-4c6a-8d59-5c581e45aa2f service nova] Enqueued Resource ID: ad5e0335-03f5-413e-88dc-5138f0daa778 with Priority: HIGHEST for action security_group_rules [ 1094.870229] env[70392]: INFO networking_nsxv3.common.synchronization [req-a1839317-040b-4027-83ab-c03822afc8b6 req-3eeff0e8-2ffe-4c6a-8d59-5c581e45aa2f service nova] Enqueued Resource ID: ad5e0335-03f5-413e-88dc-5138f0daa778 with Priority: HIGHEST for action security_group_members [ 1094.870229] env[70392]: INFO networking_nsxv3.common.synchronization [req-a1839317-040b-4027-83ab-c03822afc8b6 req-3eeff0e8-2ffe-4c6a-8d59-5c581e45aa2f service nova] Enqueued Resource ID: c78933f5-9fec-4217-94ed-483a36952363 with Priority: HIGHEST for action port [ 1094.870229] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad5e0335-03f5-413e-88dc-5138f0daa778 with Priority: HIGHEST for action security_group_rules [ 1094.870229] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad5e0335-03f5-413e-88dc-5138f0daa778 with Priority: HIGHEST for action security_group_members [ 1094.870229] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c78933f5-9fec-4217-94ed-483a36952363 with Priority: HIGHEST for action port [ 1094.870229] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad5e0335-03f5-413e-88dc-5138f0daa778 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.870229] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad5e0335-03f5-413e-88dc-5138f0daa778" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.870229] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad5e0335-03f5-413e-88dc-5138f0daa778" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.870229] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad5e0335-03f5-413e-88dc-5138f0daa778" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.870604] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad5e0335-03f5-413e-88dc-5138f0daa778',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.871705] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad5e0335-03f5-413e-88dc-5138f0daa778 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.871705] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad5e0335-03f5-413e-88dc-5138f0daa778" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.871837] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad5e0335-03f5-413e-88dc-5138f0daa778" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.871937] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad5e0335-03f5-413e-88dc-5138f0daa778" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.872110] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.872201] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.872261] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.873848] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.873848] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.873848] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad5e0335-03f5-413e-88dc-5138f0daa778',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.873848] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-c78933f5-9fec-4217-94ed-483a36952363 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.873848] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c78933f5-9fec-4217-94ed-483a36952363" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.873848] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c78933f5-9fec-4217-94ed-483a36952363" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.873848] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c78933f5-9fec-4217-94ed-483a36952363" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.873848] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c78933f5-9fec-4217-94ed-483a36952363',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.029450] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.029608] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.029668] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.029879] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.029971] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.030085] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3e59ae3-629d-4146-9bee-ef9808a03841 is going to be updated. [ 1095.058677] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.058871] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.058928] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.059121] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.059267] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.068447] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3e59ae3-629d-4146-9bee-ef9808a03841 in Status: IN_PROGRESS for 2s [ 1095.240449] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.240681] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.240681] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.241272] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.241272] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.241272] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eee84844-ea79-48de-9294-c53a759dc328 is going to be updated. [ 1095.273740] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.274046] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.274102] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.274430] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.274624] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.288307] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eee84844-ea79-48de-9294-c53a759dc328 in Status: IN_PROGRESS for 2s [ 1095.375349] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad5e0335-03f5-413e-88dc-5138f0daa778 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.375547] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad5e0335-03f5-413e-88dc-5138f0daa778" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.379415] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ad5e0335-03f5-413e-88dc-5138f0daa778',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.379415] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c78933f5-9fec-4217-94ed-483a36952363 with status ACTIVE [ 1095.379915] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.380087] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.380161] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.380446] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.380682] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.380782] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.380901] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.380975] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.381242] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.381358] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.381636] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.381751] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.381829] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.382022] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.382136] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.382485] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c78933f5-9fec-4217-94ed-483a36952363 is going to be updated. [ 1095.404032] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.404235] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.404351] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.404602] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.404862] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.404961] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c78933f5-9fec-4217-94ed-483a36952363" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.879507] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ad5e0335-03f5-413e-88dc-5138f0daa778',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.047200] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8c45013-4f96-4753-81c1-dc9e755bf45a in Status: SUCCESS [ 1096.047376] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8c45013-4f96-4753-81c1-dc9e755bf45a deletion is rescheduled due to dependency. [ 1096.047479] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8c45013-4f96-4753-81c1-dc9e755bf45a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.381528] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.381814] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.381866] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.382068] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.382164] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.382268] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad5e0335-03f5-413e-88dc-5138f0daa778 is going to be created. [ 1096.409038] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.409038] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.409038] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.409038] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.409038] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.420558] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad5e0335-03f5-413e-88dc-5138f0daa778 in Status: UNINITIALIZED for 2s [ 1096.647656] env[70392]: INFO networking_nsxv3.common.synchronization [None req-302726db-00dc-40d4-9a92-30a12b20ddee tempest-AttachInterfacesTestJSON-2046649887 tempest-AttachInterfacesTestJSON-2046649887-project-member] Enqueued Resource ID: 73f697c6-7f54-4f76-8856-ccf1651be1c2 with Priority: HIGHEST for action security_group_rules [ 1096.648297] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73f697c6-7f54-4f76-8856-ccf1651be1c2 with Priority: HIGHEST for action security_group_rules [ 1096.648649] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-73f697c6-7f54-4f76-8856-ccf1651be1c2 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.648800] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-73f697c6-7f54-4f76-8856-ccf1651be1c2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.648904] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-73f697c6-7f54-4f76-8856-ccf1651be1c2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.649210] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-73f697c6-7f54-4f76-8856-ccf1651be1c2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.649321] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('73f697c6-7f54-4f76-8856-ccf1651be1c2',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.735375] env[70392]: INFO networking_nsxv3.common.synchronization [None req-6ce5ec0a-83e2-4e3d-b0b0-09d838b55dd9 tempest-AttachInterfacesTestJSON-2046649887 tempest-AttachInterfacesTestJSON-2046649887-project-member] Enqueued Resource ID: 73f697c6-7f54-4f76-8856-ccf1651be1c2 with Priority: HIGHEST for action security_group_rules [ 1096.735778] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73f697c6-7f54-4f76-8856-ccf1651be1c2 with Priority: HIGHEST for action security_group_rules [ 1096.737938] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-73f697c6-7f54-4f76-8856-ccf1651be1c2 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.738126] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-73f697c6-7f54-4f76-8856-ccf1651be1c2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.082443] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3e59ae3-629d-4146-9bee-ef9808a03841 in Status: SUCCESS [ 1097.082718] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.083246] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.083246] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.083423] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.083423] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.083516] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.083610] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.083904] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.083904] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.083904] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c3e59ae3-629d-4146-9bee-ef9808a03841',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.174771] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.174923] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.175036] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.175253] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.175398] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.175447] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 73f697c6-7f54-4f76-8856-ccf1651be1c2 already deleted. [ 1097.175508] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-73f697c6-7f54-4f76-8856-ccf1651be1c2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.175654] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-73f697c6-7f54-4f76-8856-ccf1651be1c2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.178151] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-73f697c6-7f54-4f76-8856-ccf1651be1c2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.178265] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('73f697c6-7f54-4f76-8856-ccf1651be1c2',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.298968] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eee84844-ea79-48de-9294-c53a759dc328 in Status: SUCCESS [ 1097.299247] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.587791] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3e59ae3-629d-4146-9bee-ef9808a03841 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.588019] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.588074] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.588320] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.588502] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.588611] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.588686] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.588873] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.589097] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.589097] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.589223] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3e59ae3-629d-4146-9bee-ef9808a03841 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.589288] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.589346] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.589495] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.589630] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.589722] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.589780] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.589969] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.590058] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.590138] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.590227] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c3e59ae3-629d-4146-9bee-ef9808a03841',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.707244] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.707244] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.707244] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.707244] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.707244] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.707244] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 73f697c6-7f54-4f76-8856-ccf1651be1c2 already deleted. [ 1097.707244] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-73f697c6-7f54-4f76-8856-ccf1651be1c2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.093301] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c3e59ae3-629d-4146-9bee-ef9808a03841: rpc.has_security_group_logging(os_id): False [ 1098.123381] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.123594] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.123639] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.123854] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.123945] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.124168] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.124270] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.124333] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.124486] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.124935] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.124935] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.124935] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.124935] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.125231] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.125231] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.125380] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.125545] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.125545] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.125690] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.125773] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.125859] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c3e59ae3-629d-4146-9bee-ef9808a03841 is going to be updated. [ 1098.207201] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.207438] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.207565] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.207744] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.207910] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.247542] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c3e59ae3-629d-4146-9bee-ef9808a03841 in Status: IN_PROGRESS for 2s [ 1098.432368] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad5e0335-03f5-413e-88dc-5138f0daa778 in Status: SUCCESS [ 1098.432621] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad5e0335-03f5-413e-88dc-5138f0daa778" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.432807] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad5e0335-03f5-413e-88dc-5138f0daa778" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.433068] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad5e0335-03f5-413e-88dc-5138f0daa778" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.433266] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.433384] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.433441] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.433607] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.433699] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.433789] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad5e0335-03f5-413e-88dc-5138f0daa778" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.433880] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ad5e0335-03f5-413e-88dc-5138f0daa778',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.936747] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ad5e0335-03f5-413e-88dc-5138f0daa778',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.440284] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ad5e0335-03f5-413e-88dc-5138f0daa778: rpc.has_security_group_logging(os_id): False [ 1099.459971] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.460185] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.460262] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.460529] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.460642] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.460913] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.461027] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.461111] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.461264] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.461344] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.461462] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad5e0335-03f5-413e-88dc-5138f0daa778 is going to be created. [ 1099.557024] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.557244] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.557322] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.557586] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.557796] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.571759] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad5e0335-03f5-413e-88dc-5138f0daa778 in Status: IN_PROGRESS for 2s [ 1100.260641] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c3e59ae3-629d-4146-9bee-ef9808a03841 in Status: SUCCESS [ 1100.260884] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.974210] env[70392]: INFO networking_nsxv3.common.synchronization [req-f3a9249f-3dce-4c76-ad94-fb88f71a1882 req-5e26bafb-0556-4268-a933-f4540eedc93d tempest-ServersTestManualDisk-1686983804 tempest-ServersTestManualDisk-1686983804-project-member] Enqueued Resource ID: 07383bb9-9bd2-43da-8cb5-da905d6129d5 with Priority: HIGHEST for action security_group_members [ 1100.974422] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07383bb9-9bd2-43da-8cb5-da905d6129d5 with Priority: HIGHEST for action security_group_members [ 1100.974538] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-07383bb9-9bd2-43da-8cb5-da905d6129d5 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.976027] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07383bb9-9bd2-43da-8cb5-da905d6129d5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.976027] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07383bb9-9bd2-43da-8cb5-da905d6129d5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.976027] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07383bb9-9bd2-43da-8cb5-da905d6129d5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.976027] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.976027] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.976027] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.976027] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.976027] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.976027] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07383bb9-9bd2-43da-8cb5-da905d6129d5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.075983] env[70392]: INFO networking_nsxv3.common.synchronization [req-f0b31614-0bf5-4191-ba98-9853462edc47 req-7f74c98a-b84f-44d7-b6b3-589f742db0f0 tempest-AttachVolumeTestJSON-1272662447 tempest-AttachVolumeTestJSON-1272662447-project-member] Enqueued Resource ID: 2dfa1026-01a5-4176-a643-8ab1ceda5ce6 with Priority: HIGHEST for action security_group_members [ 1101.077131] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2dfa1026-01a5-4176-a643-8ab1ceda5ce6 with Priority: HIGHEST for action security_group_members [ 1101.077266] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-2dfa1026-01a5-4176-a643-8ab1ceda5ce6 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.077427] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2dfa1026-01a5-4176-a643-8ab1ceda5ce6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.077572] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2dfa1026-01a5-4176-a643-8ab1ceda5ce6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.077794] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2dfa1026-01a5-4176-a643-8ab1ceda5ce6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.078018] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.078172] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.078271] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.078487] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.078614] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.078751] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2dfa1026-01a5-4176-a643-8ab1ceda5ce6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.480941] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.481130] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.481292] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.481590] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.481753] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.482032] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.482513] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.482513] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.482725] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.482917] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.483282] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07383bb9-9bd2-43da-8cb5-da905d6129d5 is going to be updated. [ 1101.522163] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.522308] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.522378] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.522617] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.522848] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.536209] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07383bb9-9bd2-43da-8cb5-da905d6129d5 in Status: IN_PROGRESS for 2s [ 1101.581584] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.581780] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.581856] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.582092] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.582186] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.582390] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.582489] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.582552] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.582777] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.582811] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.582923] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2dfa1026-01a5-4176-a643-8ab1ceda5ce6 is going to be updated. [ 1101.585562] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad5e0335-03f5-413e-88dc-5138f0daa778 in Status: SUCCESS [ 1101.585775] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad5e0335-03f5-413e-88dc-5138f0daa778" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.614760] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.614945] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.614995] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.615274] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.615416] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.624401] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2dfa1026-01a5-4176-a643-8ab1ceda5ce6 in Status: IN_PROGRESS for 2s [ 1101.815525] env[70392]: INFO networking_nsxv3.common.synchronization [req-2699a27e-fbdd-414c-8eea-a5a4e68c427e req-c59e4bf6-4d3b-4e29-b1ef-a120cbbb6aca tempest-ImagesTestJSON-499820929 tempest-ImagesTestJSON-499820929-project-member] Enqueued Resource ID: bca01ddc-73d5-4856-bbff-aefad642492a with Priority: HIGHEST for action security_group_members [ 1101.816131] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bca01ddc-73d5-4856-bbff-aefad642492a with Priority: HIGHEST for action security_group_members [ 1101.816952] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-bca01ddc-73d5-4856-bbff-aefad642492a taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.817139] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.817209] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.817382] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.817563] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.817668] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.817735] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.817894] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.817980] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.818090] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bca01ddc-73d5-4856-bbff-aefad642492a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.198150] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-153 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.198150] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-153" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.198150] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-153" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.198150] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-153" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.198150] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.198150] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.198150] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.198827] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.199182] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.199573] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1102.199858] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1102.200514] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1102.200803] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1102.201087] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1102.201337] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1102.201603] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1102.230384] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1102.230384] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1102.230384] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1102.230384] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-153" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.230384] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-810dd8af-47b3-476c-a98a-88ca03c3e126 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.230384] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-810dd8af-47b3-476c-a98a-88ca03c3e126" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.230384] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-810dd8af-47b3-476c-a98a-88ca03c3e126" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.230384] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-810dd8af-47b3-476c-a98a-88ca03c3e126" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.230384] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('810dd8af-47b3-476c-a98a-88ca03c3e126',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.324783] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bca01ddc-73d5-4856-bbff-aefad642492a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.737073] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.737073] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.737073] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.737073] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.737073] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.737073] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 810dd8af-47b3-476c-a98a-88ca03c3e126 not found, creating... [ 1102.737073] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.737073] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.737073] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.737073] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.737073] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.737618] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.737618] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.737618] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.737899] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.738181] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.738441] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 810dd8af-47b3-476c-a98a-88ca03c3e126 is going to be created. [ 1102.759036] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.759618] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.759902] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.760323] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.760718] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.761261] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-810dd8af-47b3-476c-a98a-88ca03c3e126" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.815027] env[70392]: INFO networking_nsxv3.common.synchronization [req-9a17ace2-bfd5-44df-a0d2-6f370eb73c68 req-ff731207-b0f0-4858-9d00-78661de93209 tempest-ServersNegativeTestJSON-1387658603 tempest-ServersNegativeTestJSON-1387658603-project-member] Enqueued Resource ID: c3e59ae3-629d-4146-9bee-ef9808a03841 with Priority: HIGHEST for action security_group_members [ 1102.815027] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3e59ae3-629d-4146-9bee-ef9808a03841 with Priority: HIGHEST for action security_group_members [ 1102.815027] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3e59ae3-629d-4146-9bee-ef9808a03841 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.815027] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.815027] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.815027] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.815027] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.815027] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.815027] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.815668] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.815879] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.817148] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c3e59ae3-629d-4146-9bee-ef9808a03841',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.828426] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bca01ddc-73d5-4856-bbff-aefad642492a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.318868] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c3e59ae3-629d-4146-9bee-ef9808a03841',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.329731] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.329977] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.329977] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.330175] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.330298] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.330409] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bca01ddc-73d5-4856-bbff-aefad642492a is going to be updated. [ 1103.372324] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.372499] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.372553] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.373378] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.373378] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.382121] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bca01ddc-73d5-4856-bbff-aefad642492a in Status: IN_PROGRESS for 2s [ 1103.510560] env[70392]: INFO networking_nsxv3.common.synchronization [req-2699a27e-fbdd-414c-8eea-a5a4e68c427e req-1a150fbf-7be7-4549-af40-994abb7e998d service nova] Enqueued Resource ID: bca01ddc-73d5-4856-bbff-aefad642492a with Priority: HIGHEST for action security_group_rules [ 1103.510746] env[70392]: INFO networking_nsxv3.common.synchronization [req-2699a27e-fbdd-414c-8eea-a5a4e68c427e req-1a150fbf-7be7-4549-af40-994abb7e998d service nova] Enqueued Resource ID: bca01ddc-73d5-4856-bbff-aefad642492a with Priority: HIGHEST for action security_group_members [ 1103.510888] env[70392]: INFO networking_nsxv3.common.synchronization [req-2699a27e-fbdd-414c-8eea-a5a4e68c427e req-1a150fbf-7be7-4549-af40-994abb7e998d service nova] Enqueued Resource ID: 810dd8af-47b3-476c-a98a-88ca03c3e126 with Priority: HIGHEST for action port [ 1103.511214] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bca01ddc-73d5-4856-bbff-aefad642492a with Priority: HIGHEST for action security_group_rules [ 1103.511356] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bca01ddc-73d5-4856-bbff-aefad642492a with Priority: HIGHEST for action security_group_members [ 1103.511464] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 810dd8af-47b3-476c-a98a-88ca03c3e126 with Priority: HIGHEST for action port [ 1103.512016] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bca01ddc-73d5-4856-bbff-aefad642492a taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.517473] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.517561] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.517866] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.517951] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bca01ddc-73d5-4856-bbff-aefad642492a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.519100] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-bca01ddc-73d5-4856-bbff-aefad642492a taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.519207] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.519438] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-810dd8af-47b3-476c-a98a-88ca03c3e126 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.519539] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-810dd8af-47b3-476c-a98a-88ca03c3e126" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.519598] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-810dd8af-47b3-476c-a98a-88ca03c3e126" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.519770] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-810dd8af-47b3-476c-a98a-88ca03c3e126" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.519848] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('810dd8af-47b3-476c-a98a-88ca03c3e126',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.547490] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07383bb9-9bd2-43da-8cb5-da905d6129d5 in Status: SUCCESS [ 1103.547618] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07383bb9-9bd2-43da-8cb5-da905d6129d5 deletion is rescheduled due to dependency. [ 1103.547693] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07383bb9-9bd2-43da-8cb5-da905d6129d5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.634590] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2dfa1026-01a5-4176-a643-8ab1ceda5ce6 in Status: SUCCESS [ 1103.634813] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2dfa1026-01a5-4176-a643-8ab1ceda5ce6 deletion is rescheduled due to dependency. [ 1103.635037] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2dfa1026-01a5-4176-a643-8ab1ceda5ce6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.820724] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c3e59ae3-629d-4146-9bee-ef9808a03841',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.022280] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-bca01ddc-73d5-4856-bbff-aefad642492a taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.022280] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.028829] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 810dd8af-47b3-476c-a98a-88ca03c3e126 with status ACTIVE [ 1104.028829] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.028829] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.028829] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.028829] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.028829] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.028829] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.028829] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.028829] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.028829] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.028829] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.028829] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.028829] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.028829] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.028829] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.028829] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.028829] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 810dd8af-47b3-476c-a98a-88ca03c3e126 is going to be updated. [ 1104.052663] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.052663] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.052663] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.052663] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.052663] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.052663] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-810dd8af-47b3-476c-a98a-88ca03c3e126" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.324844] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.325509] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.325957] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.326366] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.326602] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.326874] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3e59ae3-629d-4146-9bee-ef9808a03841 is going to be updated. [ 1104.361266] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.361500] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.361500] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.361716] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.361867] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.372231] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3e59ae3-629d-4146-9bee-ef9808a03841 in Status: IN_PROGRESS for 2s [ 1105.391594] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bca01ddc-73d5-4856-bbff-aefad642492a in Status: SUCCESS [ 1105.391893] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.392066] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.392291] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.392479] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.392674] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.392674] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.392931] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.392931] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.393179] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bca01ddc-73d5-4856-bbff-aefad642492a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.666267] env[70392]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1105.666267] env[70392]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] NSXv3 Agent Agent loop - iteration:2 started [ 1105.896412] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bca01ddc-73d5-4856-bbff-aefad642492a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.233494] env[70392]: INFO networking_nsxv3.common.synchronization [req-a6e5bdee-56ef-4dad-bbe7-097669cec892 req-4b2a4735-de7d-4a7d-a6e3-193800921085 tempest-ServersAdminTestJSON-721710769 tempest-ServersAdminTestJSON-721710769-project-member] Enqueued Resource ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 with Priority: HIGHEST for action security_group_members [ 1106.234170] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 with Priority: HIGHEST for action security_group_members [ 1106.234376] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-f54639a3-c11e-4833-b47a-e0b477c46dd5 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.234502] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.234564] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.234871] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.234950] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.236386] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.236478] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.236668] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.236970] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.236970] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f54639a3-c11e-4833-b47a-e0b477c46dd5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.382956] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3e59ae3-629d-4146-9bee-ef9808a03841 in Status: SUCCESS [ 1106.383246] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.398787] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bca01ddc-73d5-4856-bbff-aefad642492a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.533183] env[70392]: INFO networking_nsxv3.common.synchronization [req-c8d0810f-1f13-4939-8494-654ed292e80c req-835d64da-298c-4502-b9ac-cf7e07c43e58 tempest-ServerActionsTestOtherA-1411478130 tempest-ServerActionsTestOtherA-1411478130-project-member] Enqueued Resource ID: bb62eb06-eeb8-448e-a256-ef5cfef1b811 with Priority: HIGHEST for action security_group_members [ 1106.533734] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb62eb06-eeb8-448e-a256-ef5cfef1b811 with Priority: HIGHEST for action security_group_members [ 1106.534049] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb62eb06-eeb8-448e-a256-ef5cfef1b811 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.534173] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb62eb06-eeb8-448e-a256-ef5cfef1b811" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.534333] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb62eb06-eeb8-448e-a256-ef5cfef1b811" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.534591] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb62eb06-eeb8-448e-a256-ef5cfef1b811" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.534754] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.534857] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.534920] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.535085] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.535224] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.535325] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb62eb06-eeb8-448e-a256-ef5cfef1b811',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.741117] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.741451] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.741644] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.743215] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.764782] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.765217] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.765511] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.765701] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.766103] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.766567] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.768224] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 is going to be updated. [ 1106.797917] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.798378] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.798460] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.798730] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.799086] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.812299] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 in Status: IN_PROGRESS for 2s [ 1106.886283] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-844 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.887478] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-844" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.887478] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-844" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.887478] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-844" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.887478] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.887478] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.887478] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.887777] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.887895] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.889672] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1106.889672] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1106.889672] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1106.889672] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1106.889672] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1106.889672] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1106.889672] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1106.906016] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.906016] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.906016] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.906016] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.906016] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.906016] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bca01ddc-73d5-4856-bbff-aefad642492a is going to be updated. [ 1106.909919] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1106.909919] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1106.909919] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1106.909919] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-844" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.909919] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-3dca17e3-653a-4892-8192-94e83157df34 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.909919] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-3dca17e3-653a-4892-8192-94e83157df34" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.911711] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-3dca17e3-653a-4892-8192-94e83157df34" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.911711] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-3dca17e3-653a-4892-8192-94e83157df34" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.911711] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3dca17e3-653a-4892-8192-94e83157df34',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.936145] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.936334] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.936411] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.936620] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.936767] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.950757] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bca01ddc-73d5-4856-bbff-aefad642492a in Status: IN_PROGRESS for 2s [ 1107.038802] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.038982] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.039060] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.039275] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.039376] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.039575] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.039672] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.039731] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.039887] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.039958] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.040499] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb62eb06-eeb8-448e-a256-ef5cfef1b811 already deleted. [ 1107.040499] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb62eb06-eeb8-448e-a256-ef5cfef1b811" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.413424] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.413729] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.413823] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.414104] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.414276] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.414473] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 3dca17e3-653a-4892-8192-94e83157df34 not found, creating... [ 1107.414743] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.414975] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.415037] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.415287] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.415472] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.415715] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.415896] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.416015] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.416265] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.416473] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.416556] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 3dca17e3-653a-4892-8192-94e83157df34 is going to be created. [ 1107.436084] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.436372] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.436473] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.436747] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.437270] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.437270] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-3dca17e3-653a-4892-8192-94e83157df34" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.681864] env[70392]: INFO networking_nsxv3.common.synchronization [req-c8d0810f-1f13-4939-8494-654ed292e80c req-e0dd52bb-7375-497d-9f87-21c93b8744fd service nova] Enqueued Resource ID: bb62eb06-eeb8-448e-a256-ef5cfef1b811 with Priority: HIGHEST for action security_group_rules [ 1108.682163] env[70392]: INFO networking_nsxv3.common.synchronization [req-c8d0810f-1f13-4939-8494-654ed292e80c req-e0dd52bb-7375-497d-9f87-21c93b8744fd service nova] Enqueued Resource ID: bb62eb06-eeb8-448e-a256-ef5cfef1b811 with Priority: HIGHEST for action security_group_members [ 1108.682281] env[70392]: INFO networking_nsxv3.common.synchronization [req-c8d0810f-1f13-4939-8494-654ed292e80c req-e0dd52bb-7375-497d-9f87-21c93b8744fd service nova] Enqueued Resource ID: 3dca17e3-653a-4892-8192-94e83157df34 with Priority: HIGHEST for action port [ 1108.682478] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb62eb06-eeb8-448e-a256-ef5cfef1b811 with Priority: HIGHEST for action security_group_rules [ 1108.682628] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb62eb06-eeb8-448e-a256-ef5cfef1b811 with Priority: HIGHEST for action security_group_members [ 1108.682712] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3dca17e3-653a-4892-8192-94e83157df34 with Priority: HIGHEST for action port [ 1108.683432] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bb62eb06-eeb8-448e-a256-ef5cfef1b811 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.683687] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bb62eb06-eeb8-448e-a256-ef5cfef1b811" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.683687] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bb62eb06-eeb8-448e-a256-ef5cfef1b811" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.683865] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bb62eb06-eeb8-448e-a256-ef5cfef1b811" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.684014] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bb62eb06-eeb8-448e-a256-ef5cfef1b811',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.686412] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb62eb06-eeb8-448e-a256-ef5cfef1b811 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.686412] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb62eb06-eeb8-448e-a256-ef5cfef1b811" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.686412] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb62eb06-eeb8-448e-a256-ef5cfef1b811" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.686600] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb62eb06-eeb8-448e-a256-ef5cfef1b811" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.686644] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.686788] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.686846] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.686981] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.687081] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.687179] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb62eb06-eeb8-448e-a256-ef5cfef1b811',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.689046] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-3dca17e3-653a-4892-8192-94e83157df34 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.689046] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3dca17e3-653a-4892-8192-94e83157df34" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.689046] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3dca17e3-653a-4892-8192-94e83157df34" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.689046] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3dca17e3-653a-4892-8192-94e83157df34" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.689046] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3dca17e3-653a-4892-8192-94e83157df34',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.823788] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 in Status: SUCCESS [ 1108.823947] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 deletion is rescheduled due to dependency. [ 1108.824085] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.963013] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bca01ddc-73d5-4856-bbff-aefad642492a in Status: SUCCESS [ 1108.963229] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.963448] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.963673] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.963866] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.964032] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.964119] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.964254] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.964385] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.964465] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.964559] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bca01ddc-73d5-4856-bbff-aefad642492a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.186567] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb62eb06-eeb8-448e-a256-ef5cfef1b811 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.186754] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb62eb06-eeb8-448e-a256-ef5cfef1b811" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.190153] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bb62eb06-eeb8-448e-a256-ef5cfef1b811',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.193223] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3dca17e3-653a-4892-8192-94e83157df34 with status ACTIVE [ 1109.193223] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.193223] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.193223] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.193223] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.193223] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.193223] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.193223] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.193223] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.193223] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.193223] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.193912] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.193912] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.193912] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.193912] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.193912] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.193912] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3dca17e3-653a-4892-8192-94e83157df34 is going to be updated. [ 1109.218484] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.218700] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.218824] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.219095] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.219273] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.219518] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3dca17e3-653a-4892-8192-94e83157df34" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.466689] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-bca01ddc-73d5-4856-bbff-aefad642492a taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.466864] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.466914] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.467195] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.467382] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.467492] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.467707] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.467912] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.468019] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.468119] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.468289] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-bca01ddc-73d5-4856-bbff-aefad642492a taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.468394] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.468463] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.468614] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.468771] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.468866] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.468928] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.469099] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.469182] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.469271] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.469364] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bca01ddc-73d5-4856-bbff-aefad642492a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.697165] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bb62eb06-eeb8-448e-a256-ef5cfef1b811',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.972166] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bca01ddc-73d5-4856-bbff-aefad642492a: rpc.has_security_group_logging(os_id): False [ 1110.002706] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.002896] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.002991] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.003268] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.003408] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.003705] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.003850] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.003948] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.004207] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.004399] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.004649] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.004800] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.004927] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.005153] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.005294] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.005553] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.005697] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.005804] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.006016] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.006159] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.006302] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bca01ddc-73d5-4856-bbff-aefad642492a is going to be updated. [ 1110.075612] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.075780] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.075780] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.075992] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.076168] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.095102] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bca01ddc-73d5-4856-bbff-aefad642492a in Status: IN_PROGRESS for 2s [ 1110.198836] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.199091] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.199174] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.199445] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.199544] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.199652] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb62eb06-eeb8-448e-a256-ef5cfef1b811 is going to be created. [ 1110.236946] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.237113] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.237113] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.237294] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.237794] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.252223] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb62eb06-eeb8-448e-a256-ef5cfef1b811 in Status: UNINITIALIZED for 2s [ 1111.609124] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.609408] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.609408] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.609620] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.609760] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.113032] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.116069] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bca01ddc-73d5-4856-bbff-aefad642492a in Status: SUCCESS [ 1112.116069] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.265866] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb62eb06-eeb8-448e-a256-ef5cfef1b811 in Status: SUCCESS [ 1112.266095] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb62eb06-eeb8-448e-a256-ef5cfef1b811" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.266283] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb62eb06-eeb8-448e-a256-ef5cfef1b811" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.267652] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb62eb06-eeb8-448e-a256-ef5cfef1b811" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.267652] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.267652] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.267652] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.267652] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.267652] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.267652] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb62eb06-eeb8-448e-a256-ef5cfef1b811" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.267652] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bb62eb06-eeb8-448e-a256-ef5cfef1b811',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.615462] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.769695] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bb62eb06-eeb8-448e-a256-ef5cfef1b811',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.119017] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1113.119017] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1113.273149] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bb62eb06-eeb8-448e-a256-ef5cfef1b811: rpc.has_security_group_logging(os_id): False [ 1113.297328] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.297480] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.297617] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.297843] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.297980] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.298201] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.298346] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.298468] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.298742] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.298742] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.298869] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bb62eb06-eeb8-448e-a256-ef5cfef1b811 is going to be created. [ 1113.374434] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.374833] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.374963] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.375240] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.375508] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.396051] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bb62eb06-eeb8-448e-a256-ef5cfef1b811 in Status: IN_PROGRESS for 2s [ 1113.688602] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1113.688602] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1114.079061] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.079228] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.079288] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.079519] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.091781] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1114.092780] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.094142] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1114.134221] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.134436] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.134436] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.134625] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.146311] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.147257] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1114.147332] env[70392]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=70392) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1114.147439] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1114.204846] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.205046] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.205139] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.205565] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.207193] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.207445] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1114.312014] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.312197] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.312269] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.312492] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.312788] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.314770] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1114.410693] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.410926] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.411053] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.411351] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.411837] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.412283] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:48. [ 1114.412283] env[70392]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'43327972-df6d-4e69-b782-fda3a340af0a', '247680ec-824d-41ac-8735-1edb7b119a99', 'ad5e0335-03f5-413e-88dc-5138f0daa778', '47a435cb-d815-4f84-b215-41c82faf33b9', '5fec7002-3137-40f1-a653-f520126396a2', 'ce79170a-31ce-429e-8e08-a911557872f4', '3b776bd0-c07d-4db7-beb4-bf0b0360a21c', 'f54639a3-c11e-4833-b47a-e0b477c46dd5', 'eee84844-ea79-48de-9294-c53a759dc328', '5142002e-26fc-486e-b9c2-236f95ba1fa4', '7f78f149-d978-4089-8aa8-d480e7d7bb61', '2d7b5b77-fadf-41e0-8ec9-a51ed0af628a', 'f5251c5e-578a-48aa-8195-e1dc88834ad8', '40ebe9d4-d512-4967-99a6-0a7cf11dc1cd', '20f5b49b-d835-491d-a710-e2565f4af8b5', '1c75159c-a2db-4a16-8163-159ea78c9c84', 'fc6010b2-a356-4e5d-898a-bf9ca32456ec', 'dbeb3b19-0a8e-4685-84e0-239c82418063', '7fe12613-4be5-4b59-9116-6e8887356711', 'bb62eb06-eeb8-448e-a256-ef5cfef1b811', '4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b', 'b60d7eaa-9583-4c75-97fa-4049c63576b6', '19062702-bd29-4477-a732-5169f347b4da', '07383bb9-9bd2-43da-8cb5-da905d6129d5', 'f8c45013-4f96-4753-81c1-dc9e755bf45a', 'db50a8fd-2283-44bb-910d-f7a2f2541f14', 'f0999f45-c89f-488f-b038-36a93b2cdeb4', '12100879-b33a-4e8b-8947-ed54d332f821', 'ac589e4e-a2e5-4716-8490-eecefc1b6a5e', '7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5', '4f7f8865-743f-4e67-8bf2-9a21ed1eaac4', 'bca01ddc-73d5-4856-bbff-aefad642492a', '2dfa1026-01a5-4176-a643-8ab1ceda5ce6', '839b66b0-e5ba-4f94-b08b-508956410270', '3507e503-4abd-47ec-8347-82fc9e691881', 'fcc3c75c-0cae-4c7c-8f32-6c948e76880d', 'c3e59ae3-629d-4146-9bee-ef9808a03841', '49e97029-e971-47d3-aa73-0fe54ba5d0b0', '438fa731-ac4f-4636-ae4b-8e30973002cd', '623be016-3395-49f1-ae71-2a2052cde818', 'ee8b641c-b2f7-4b94-85bb-98a31dba1604', 'cca6e4dd-68c9-4fd2-8e1a-cda645da02e4', 'c1385665-0c09-423f-98c4-4d6b46c66ec0', '59adf132-72f4-4d43-847e-1af9bc3c6073', '56238df1-04a7-4a59-9d0f-ea911fb29f15', '03a8a1fe-a465-4403-8e2c-2170f54b59a0', 'fc49f827-a914-4b77-820c-bb2bf63c8bc7', '44698b7f-7125-46d0-837f-5d44d3ee1aea'} {{(pid=70392) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1114.412283] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1114.442483] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.442667] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.442744] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.442982] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.443091] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.443251] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1114.443354] env[70392]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=70392) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1114.443444] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1114.531009] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.531273] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.531385] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.531617] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.533234] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.533758] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1114.533842] env[70392]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=70392) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1114.533930] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1114.534061] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1114.534247] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/48 resources of Type:Security Group Rules [ 1114.534353] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 43327972-df6d-4e69-b782-fda3a340af0a with Priority: HIGH for action security_group_rules [ 1114.534459] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 247680ec-824d-41ac-8735-1edb7b119a99 with Priority: HIGH for action security_group_rules [ 1114.534547] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ad5e0335-03f5-413e-88dc-5138f0daa778 with Priority: HIGH for action security_group_rules [ 1114.534644] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 47a435cb-d815-4f84-b215-41c82faf33b9 with Priority: HIGH for action security_group_rules [ 1114.534709] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5fec7002-3137-40f1-a653-f520126396a2 with Priority: HIGH for action security_group_rules [ 1114.534819] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ce79170a-31ce-429e-8e08-a911557872f4 with Priority: HIGH for action security_group_rules [ 1114.534944] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3b776bd0-c07d-4db7-beb4-bf0b0360a21c with Priority: HIGH for action security_group_rules [ 1114.535076] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 with Priority: HIGH for action security_group_rules [ 1114.535159] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: eee84844-ea79-48de-9294-c53a759dc328 with Priority: HIGH for action security_group_rules [ 1114.535265] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5142002e-26fc-486e-b9c2-236f95ba1fa4 with Priority: HIGH for action security_group_rules [ 1114.535402] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7f78f149-d978-4089-8aa8-d480e7d7bb61 with Priority: HIGH for action security_group_rules [ 1114.535528] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2d7b5b77-fadf-41e0-8ec9-a51ed0af628a with Priority: HIGH for action security_group_rules [ 1114.535614] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f5251c5e-578a-48aa-8195-e1dc88834ad8 with Priority: HIGH for action security_group_rules [ 1114.535681] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 40ebe9d4-d512-4967-99a6-0a7cf11dc1cd with Priority: HIGH for action security_group_rules [ 1114.535746] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 with Priority: HIGH for action security_group_rules [ 1114.535808] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1c75159c-a2db-4a16-8163-159ea78c9c84 with Priority: HIGH for action security_group_rules [ 1114.535965] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fc6010b2-a356-4e5d-898a-bf9ca32456ec with Priority: HIGH for action security_group_rules [ 1114.536094] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dbeb3b19-0a8e-4685-84e0-239c82418063 with Priority: HIGH for action security_group_rules [ 1114.536206] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7fe12613-4be5-4b59-9116-6e8887356711 with Priority: HIGH for action security_group_rules [ 1114.536273] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bb62eb06-eeb8-448e-a256-ef5cfef1b811 with Priority: HIGH for action security_group_rules [ 1114.536386] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.408643] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bb62eb06-eeb8-448e-a256-ef5cfef1b811 in Status: SUCCESS [ 1115.408643] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bb62eb06-eeb8-448e-a256-ef5cfef1b811" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.444217] env[70392]: INFO networking_nsxv3.common.synchronization [req-1b689067-1dd9-4cd5-879a-e192f93232c5 req-d375f67b-4c27-4f48-9076-b3267266f172 tempest-ServerDiskConfigTestJSON-277542510 tempest-ServerDiskConfigTestJSON-277542510-project-member] Enqueued Resource ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 with Priority: HIGHEST for action security_group_members [ 1117.447017] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 with Priority: HIGHEST for action security_group_members [ 1117.447017] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43327972-df6d-4e69-b782-fda3a340af0a with Priority: HIGH for action security_group_rules [ 1117.447017] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad5e0335-03f5-413e-88dc-5138f0daa778 with Priority: HIGH for action security_group_rules [ 1117.447017] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b776bd0-c07d-4db7-beb4-bf0b0360a21c with Priority: HIGH for action security_group_rules [ 1117.447017] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 with Priority: HIGH for action security_group_rules [ 1117.447017] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb62eb06-eeb8-448e-a256-ef5cfef1b811 with Priority: HIGH for action security_group_rules [ 1117.447017] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fe12613-4be5-4b59-9116-6e8887356711 with Priority: HIGH for action security_group_rules [ 1117.447017] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbeb3b19-0a8e-4685-84e0-239c82418063 with Priority: HIGH for action security_group_rules [ 1117.447017] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc6010b2-a356-4e5d-898a-bf9ca32456ec with Priority: HIGH for action security_group_rules [ 1117.447017] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40ebe9d4-d512-4967-99a6-0a7cf11dc1cd with Priority: HIGH for action security_group_rules [ 1117.447017] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c75159c-a2db-4a16-8163-159ea78c9c84 with Priority: HIGH for action security_group_rules [ 1117.447017] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5251c5e-578a-48aa-8195-e1dc88834ad8 with Priority: HIGH for action security_group_rules [ 1117.447017] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d7b5b77-fadf-41e0-8ec9-a51ed0af628a with Priority: HIGH for action security_group_rules [ 1117.447017] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f78f149-d978-4089-8aa8-d480e7d7bb61 with Priority: HIGH for action security_group_rules [ 1117.447017] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5142002e-26fc-486e-b9c2-236f95ba1fa4 with Priority: HIGH for action security_group_rules [ 1117.447017] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eee84844-ea79-48de-9294-c53a759dc328 with Priority: HIGH for action security_group_rules [ 1117.447017] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce79170a-31ce-429e-8e08-a911557872f4 with Priority: HIGH for action security_group_rules [ 1117.447017] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 with Priority: HIGH for action security_group_rules [ 1117.447017] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fec7002-3137-40f1-a653-f520126396a2 with Priority: HIGH for action security_group_rules [ 1117.447564] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 247680ec-824d-41ac-8735-1edb7b119a99 with Priority: HIGH for action security_group_rules [ 1117.447564] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47a435cb-d815-4f84-b215-41c82faf33b9 with Priority: HIGH for action security_group_rules [ 1117.447692] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60d7eaa-9583-4c75-97fa-4049c63576b6 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.447819] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.447883] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.448163] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.448320] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.448423] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.448481] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.448635] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.448726] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.448831] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b60d7eaa-9583-4c75-97fa-4049c63576b6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.449896] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-43327972-df6d-4e69-b782-fda3a340af0a taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.450585] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-43327972-df6d-4e69-b782-fda3a340af0a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.450711] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-43327972-df6d-4e69-b782-fda3a340af0a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.450932] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-43327972-df6d-4e69-b782-fda3a340af0a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.451047] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('43327972-df6d-4e69-b782-fda3a340af0a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.452446] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad5e0335-03f5-413e-88dc-5138f0daa778 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.452596] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad5e0335-03f5-413e-88dc-5138f0daa778" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.452768] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad5e0335-03f5-413e-88dc-5138f0daa778" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.452955] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad5e0335-03f5-413e-88dc-5138f0daa778" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.453023] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad5e0335-03f5-413e-88dc-5138f0daa778',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.454074] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3b776bd0-c07d-4db7-beb4-bf0b0360a21c taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.454074] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3b776bd0-c07d-4db7-beb4-bf0b0360a21c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.454185] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3b776bd0-c07d-4db7-beb4-bf0b0360a21c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.454330] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3b776bd0-c07d-4db7-beb4-bf0b0360a21c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.454454] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3b776bd0-c07d-4db7-beb4-bf0b0360a21c',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.455627] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-20f5b49b-d835-491d-a710-e2565f4af8b5 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.455713] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.455790] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.456265] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.456265] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('20f5b49b-d835-491d-a710-e2565f4af8b5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.457208] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bb62eb06-eeb8-448e-a256-ef5cfef1b811 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.457920] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bb62eb06-eeb8-448e-a256-ef5cfef1b811" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.457920] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bb62eb06-eeb8-448e-a256-ef5cfef1b811" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.457920] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bb62eb06-eeb8-448e-a256-ef5cfef1b811" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.457920] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bb62eb06-eeb8-448e-a256-ef5cfef1b811',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.459099] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fe12613-4be5-4b59-9116-6e8887356711 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.459201] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fe12613-4be5-4b59-9116-6e8887356711" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.459317] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fe12613-4be5-4b59-9116-6e8887356711" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.459624] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fe12613-4be5-4b59-9116-6e8887356711" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.459675] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fe12613-4be5-4b59-9116-6e8887356711',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.460600] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dbeb3b19-0a8e-4685-84e0-239c82418063 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.460742] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.460833] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.461063] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.461168] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dbeb3b19-0a8e-4685-84e0-239c82418063',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.462171] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fc6010b2-a356-4e5d-898a-bf9ca32456ec taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.463039] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fc6010b2-a356-4e5d-898a-bf9ca32456ec" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.463039] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fc6010b2-a356-4e5d-898a-bf9ca32456ec" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.463039] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fc6010b2-a356-4e5d-898a-bf9ca32456ec" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.463039] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fc6010b2-a356-4e5d-898a-bf9ca32456ec',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.463853] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40ebe9d4-d512-4967-99a6-0a7cf11dc1cd taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.463997] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40ebe9d4-d512-4967-99a6-0a7cf11dc1cd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.464103] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40ebe9d4-d512-4967-99a6-0a7cf11dc1cd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.464335] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40ebe9d4-d512-4967-99a6-0a7cf11dc1cd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.464435] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40ebe9d4-d512-4967-99a6-0a7cf11dc1cd',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.465425] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1c75159c-a2db-4a16-8163-159ea78c9c84 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.465564] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1c75159c-a2db-4a16-8163-159ea78c9c84" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.465658] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1c75159c-a2db-4a16-8163-159ea78c9c84" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.466574] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1c75159c-a2db-4a16-8163-159ea78c9c84" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.466574] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1c75159c-a2db-4a16-8163-159ea78c9c84',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.467658] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f5251c5e-578a-48aa-8195-e1dc88834ad8 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.467773] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f5251c5e-578a-48aa-8195-e1dc88834ad8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.467869] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f5251c5e-578a-48aa-8195-e1dc88834ad8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.468088] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f5251c5e-578a-48aa-8195-e1dc88834ad8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.468191] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f5251c5e-578a-48aa-8195-e1dc88834ad8',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.469094] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2d7b5b77-fadf-41e0-8ec9-a51ed0af628a taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.469248] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2d7b5b77-fadf-41e0-8ec9-a51ed0af628a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.469349] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2d7b5b77-fadf-41e0-8ec9-a51ed0af628a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.469583] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2d7b5b77-fadf-41e0-8ec9-a51ed0af628a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.469692] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2d7b5b77-fadf-41e0-8ec9-a51ed0af628a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.470752] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f78f149-d978-4089-8aa8-d480e7d7bb61 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.470930] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f78f149-d978-4089-8aa8-d480e7d7bb61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.471046] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f78f149-d978-4089-8aa8-d480e7d7bb61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.471256] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f78f149-d978-4089-8aa8-d480e7d7bb61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.471361] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f78f149-d978-4089-8aa8-d480e7d7bb61',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.472245] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5142002e-26fc-486e-b9c2-236f95ba1fa4 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.472411] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5142002e-26fc-486e-b9c2-236f95ba1fa4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.472496] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5142002e-26fc-486e-b9c2-236f95ba1fa4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.472710] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5142002e-26fc-486e-b9c2-236f95ba1fa4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.472791] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5142002e-26fc-486e-b9c2-236f95ba1fa4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.473997] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eee84844-ea79-48de-9294-c53a759dc328 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.474146] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.474240] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.474480] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.474545] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eee84844-ea79-48de-9294-c53a759dc328',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.475562] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ce79170a-31ce-429e-8e08-a911557872f4 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.475801] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.475801] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.476747] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.476747] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ce79170a-31ce-429e-8e08-a911557872f4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.476934] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f54639a3-c11e-4833-b47a-e0b477c46dd5 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.477094] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.477191] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.477429] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.477624] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f54639a3-c11e-4833-b47a-e0b477c46dd5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.478501] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5fec7002-3137-40f1-a653-f520126396a2 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.478594] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.478695] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.478920] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.479024] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5fec7002-3137-40f1-a653-f520126396a2',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.479904] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-247680ec-824d-41ac-8735-1edb7b119a99 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.480130] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-247680ec-824d-41ac-8735-1edb7b119a99" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.480244] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-247680ec-824d-41ac-8735-1edb7b119a99" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.480470] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-247680ec-824d-41ac-8735-1edb7b119a99" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.480576] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('247680ec-824d-41ac-8735-1edb7b119a99',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.481689] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-47a435cb-d815-4f84-b215-41c82faf33b9 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.481754] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.481851] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.482138] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.482243] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('47a435cb-d815-4f84-b215-41c82faf33b9',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.582113] env[70392]: INFO networking_nsxv3.common.synchronization [req-fae766ef-c7c6-486c-9968-fbd4e297cb31 req-19817c34-82fd-4891-a122-c5b15b8fcd54 tempest-ListServerFiltersTestJSON-50551211 tempest-ListServerFiltersTestJSON-50551211-project-member] Enqueued Resource ID: 4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 with Priority: HIGHEST for action security_group_members [ 1117.582691] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 with Priority: HIGHEST for action security_group_members [ 1117.583016] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.583159] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.583226] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.583455] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.583605] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.583702] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.583765] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.583910] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.584010] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.585572] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f7f8865-743f-4e67-8bf2-9a21ed1eaac4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.988383] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad5e0335-03f5-413e-88dc-5138f0daa778 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.988551] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad5e0335-03f5-413e-88dc-5138f0daa778" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.988551] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad5e0335-03f5-413e-88dc-5138f0daa778" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.988728] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad5e0335-03f5-413e-88dc-5138f0daa778" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.988916] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.989049] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.989130] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.989208] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.989300] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.989530] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad5e0335-03f5-413e-88dc-5138f0daa778" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.989530] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ad5e0335-03f5-413e-88dc-5138f0daa778',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.990764] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-eee84844-ea79-48de-9294-c53a759dc328 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.990764] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.990764] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.990764] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.991134] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.991134] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.991134] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.991134] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.991415] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.991415] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.991415] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eee84844-ea79-48de-9294-c53a759dc328',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.995586] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.995720] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.995774] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.995952] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.997982] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb62eb06-eeb8-448e-a256-ef5cfef1b811 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.998233] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb62eb06-eeb8-448e-a256-ef5cfef1b811" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.998233] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb62eb06-eeb8-448e-a256-ef5cfef1b811" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.998460] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb62eb06-eeb8-448e-a256-ef5cfef1b811" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.998507] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.998608] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.998668] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.998815] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.998898] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.998997] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb62eb06-eeb8-448e-a256-ef5cfef1b811" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.999099] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bb62eb06-eeb8-448e-a256-ef5cfef1b811',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.012034] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-47a435cb-d815-4f84-b215-41c82faf33b9 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.012034] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.012034] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.012301] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.012481] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.012651] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.012753] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.012998] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.013149] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.013295] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.013432] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('47a435cb-d815-4f84-b215-41c82faf33b9',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.023769] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.023769] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.029140] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bb62eb06-eeb8-448e-a256-ef5cfef1b811',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.030180] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ad5e0335-03f5-413e-88dc-5138f0daa778',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.035854] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('47a435cb-d815-4f84-b215-41c82faf33b9',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.072646] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.072885] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.089677] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.090303] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.091018] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.091128] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.093718] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.093827] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.109090] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.109170] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.110104] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.110218] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.117370] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.117535] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.118612] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.118725] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.119471] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.119588] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.120301] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.120395] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.121056] env[70392]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1118.121472] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.121586] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.122346] env[70392]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1118.125415] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.125415] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.125415] env[70392]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1118.125415] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.125415] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.134097] env[70392]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1118.134852] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.134960] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.140825] env[70392]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1118.141475] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.141630] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.145155] env[70392]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1118.145155] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.145155] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.148288] env[70392]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1118.148777] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.149104] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.149361] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.149524] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.149804] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.149962] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.150098] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 is going to be updated. [ 1118.151200] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.151401] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.186206] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.186206] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1c75159c-a2db-4a16-8163-159ea78c9c84 is going to be deleted. [ 1118.187461] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.187778] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.194059] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.194059] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.194362] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.194362] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.195026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.204504] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 in Status: IN_PROGRESS for 2s [ 1118.214633] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.214753] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5fec7002-3137-40f1-a653-f520126396a2 is going to be deleted. [ 1118.215830] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.215989] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.249048] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.249048] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.249048] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.249048] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.249348] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.249348] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.249428] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 is going to be updated. [ 1118.250508] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.250724] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.279293] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.279495] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.285036] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.285203] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.286206] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.286334] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40ebe9d4-d512-4967-99a6-0a7cf11dc1cd is going to be deleted. [ 1118.287301] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.287645] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.307781] env[70392]: INFO networking_nsxv3.common.synchronization [None req-2a3c823f-c2bf-4ff7-b596-f54a3c3bf41a tempest-AttachVolumeNegativeTest-772339566 tempest-AttachVolumeNegativeTest-772339566-project-member] Enqueued Resource ID: 25d71d6e-f381-40cd-b3d0-6c5c495c4c87 with Priority: HIGHEST for action security_group_rules [ 1118.308613] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25d71d6e-f381-40cd-b3d0-6c5c495c4c87 with Priority: HIGHEST for action security_group_rules [ 1118.309063] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-25d71d6e-f381-40cd-b3d0-6c5c495c4c87 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.309150] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-25d71d6e-f381-40cd-b3d0-6c5c495c4c87" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.309233] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-25d71d6e-f381-40cd-b3d0-6c5c495c4c87" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.309578] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-25d71d6e-f381-40cd-b3d0-6c5c495c4c87" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.309666] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('25d71d6e-f381-40cd-b3d0-6c5c495c4c87',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.311475] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.311602] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.312427] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.312427] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.312427] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.322022] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.322022] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 20f5b49b-d835-491d-a710-e2565f4af8b5 is going to be deleted. [ 1118.322022] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.322022] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.322774] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 in Status: IN_PROGRESS for 2s [ 1118.377750] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.377825] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f5251c5e-578a-48aa-8195-e1dc88834ad8 is going to be deleted. [ 1118.379859] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.379859] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.405215] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.405215] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.425621] env[70392]: INFO networking_nsxv3.common.synchronization [None req-269fa606-895f-45a8-b83b-290dd1b49244 tempest-AttachVolumeNegativeTest-772339566 tempest-AttachVolumeNegativeTest-772339566-project-member] Enqueued Resource ID: 25d71d6e-f381-40cd-b3d0-6c5c495c4c87 with Priority: HIGHEST for action security_group_rules [ 1118.426599] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.426716] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f78f149-d978-4089-8aa8-d480e7d7bb61 is going to be deleted. [ 1118.428430] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25d71d6e-f381-40cd-b3d0-6c5c495c4c87 with Priority: HIGHEST for action security_group_rules [ 1118.428643] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.428870] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.432073] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.432232] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.432457] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-25d71d6e-f381-40cd-b3d0-6c5c495c4c87 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.432548] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-25d71d6e-f381-40cd-b3d0-6c5c495c4c87" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.473580] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.473910] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fc6010b2-a356-4e5d-898a-bf9ca32456ec is going to be deleted. [ 1118.476414] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.476414] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.520123] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.521711] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fe12613-4be5-4b59-9116-6e8887356711 is going to be deleted. [ 1118.522057] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-eee84844-ea79-48de-9294-c53a759dc328 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.522057] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.522219] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.522340] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.522506] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.522611] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.522735] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.523647] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.523647] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.523647] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.523647] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-eee84844-ea79-48de-9294-c53a759dc328 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.523647] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.523647] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.523647] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.523647] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.523996] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.523996] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.524130] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.524130] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.524322] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.524322] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eee84844-ea79-48de-9294-c53a759dc328',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.525106] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.526043] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.531630] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.531630] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.539106] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ad5e0335-03f5-413e-88dc-5138f0daa778: rpc.has_security_group_logging(os_id): False [ 1118.540295] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bb62eb06-eeb8-448e-a256-ef5cfef1b811: rpc.has_security_group_logging(os_id): False [ 1118.545606] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 47a435cb-d815-4f84-b215-41c82faf33b9: rpc.has_security_group_logging(os_id): False [ 1118.580691] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.580842] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.600999] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.601177] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ce79170a-31ce-429e-8e08-a911557872f4 is going to be deleted. [ 1118.602087] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.602313] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.605054] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.605164] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.609236] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.609376] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.614996] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.614996] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.615729] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.615836] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.661880] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.662037] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2d7b5b77-fadf-41e0-8ec9-a51ed0af628a is going to be deleted. [ 1118.663127] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.663452] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.725679] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.725679] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.730634] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.730813] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dbeb3b19-0a8e-4685-84e0-239c82418063 is going to be deleted. [ 1118.732275] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.732275] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.783397] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.783548] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.799155] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.799155] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 43327972-df6d-4e69-b782-fda3a340af0a is going to be deleted. [ 1118.799155] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.799155] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.842554] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.842712] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.863295] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.863295] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.864364] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.864364] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f54639a3-c11e-4833-b47a-e0b477c46dd5 is going to be deleted. [ 1118.869078] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.869400] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.887105] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.887339] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.900410] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.900410] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.927197] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.927333] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3b776bd0-c07d-4db7-beb4-bf0b0360a21c is going to be deleted. [ 1118.928246] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.928472] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.996636] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.996772] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5142002e-26fc-486e-b9c2-236f95ba1fa4 is going to be deleted. [ 1118.998628] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.998628] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.027246] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eee84844-ea79-48de-9294-c53a759dc328: rpc.has_security_group_logging(os_id): False [ 1119.044940] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.045088] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 247680ec-824d-41ac-8735-1edb7b119a99 is going to be deleted. [ 1119.046315] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.046616] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.046874] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.047032] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1c75159c-a2db-4a16-8163-159ea78c9c84" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.047922] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.048048] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.048100] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.048285] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.048372] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.048495] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f54639a3-c11e-4833-b47a-e0b477c46dd5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.048653] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.048851] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.048936] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.049081] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5fec7002-3137-40f1-a653-f520126396a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.049589] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.049750] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.049833] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.049950] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40ebe9d4-d512-4967-99a6-0a7cf11dc1cd" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.050832] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.050935] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.051015] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.051169] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.073642] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.073910] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.074050] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.074115] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.074420] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.074420] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.074588] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.074692] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.074751] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.075155] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.075155] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.075155] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.075304] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.075304] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.075461] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.075550] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.075631] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eee84844-ea79-48de-9294-c53a759dc328 is going to be updated. [ 1119.076730] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.076889] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.078785] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.078898] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.079785] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.079884] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.140434] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.140570] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.142039] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.142149] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.142246] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.142313] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.142514] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.142597] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.142696] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bb62eb06-eeb8-448e-a256-ef5cfef1b811 is going to be updated. [ 1119.143791] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.143962] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.217907] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.218238] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.218340] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.218408] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.218603] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.218684] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.218783] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 47a435cb-d815-4f84-b215-41c82faf33b9 is going to be updated. [ 1119.219854] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.220031] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.315884] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.316148] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.318398] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.318730] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.318846] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.318914] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.319170] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.319341] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.319557] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad5e0335-03f5-413e-88dc-5138f0daa778 is going to be updated. [ 1119.320662] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.321409] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.321409] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.321409] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.321409] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.322059] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.322059] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.322059] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2d7b5b77-fadf-41e0-8ec9-a51ed0af628a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.322059] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.322205] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.322205] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.322953] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 25d71d6e-f381-40cd-b3d0-6c5c495c4c87 already deleted. [ 1119.322953] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-25d71d6e-f381-40cd-b3d0-6c5c495c4c87" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.322953] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.322953] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.322953] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.322953] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dbeb3b19-0a8e-4685-84e0-239c82418063" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.324566] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.324566] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.324566] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.324566] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-43327972-df6d-4e69-b782-fda3a340af0a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.324566] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-25d71d6e-f381-40cd-b3d0-6c5c495c4c87" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.324566] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-25d71d6e-f381-40cd-b3d0-6c5c495c4c87" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.324566] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('25d71d6e-f381-40cd-b3d0-6c5c495c4c87',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.325321] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.325572] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.325696] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.325867] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-20f5b49b-d835-491d-a710-e2565f4af8b5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.326421] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.326607] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.326737] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.326915] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f5251c5e-578a-48aa-8195-e1dc88834ad8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.327116] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.327370] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.327513] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.327709] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fc6010b2-a356-4e5d-898a-bf9ca32456ec" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.327957] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.328204] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.328435] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.328517] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3b776bd0-c07d-4db7-beb4-bf0b0360a21c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.328788] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.329037] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.329177] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.329534] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5142002e-26fc-486e-b9c2-236f95ba1fa4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.329624] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.330274] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.330274] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.330274] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-247680ec-824d-41ac-8735-1edb7b119a99" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.330274] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.330429] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.330503] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.330621] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f78f149-d978-4089-8aa8-d480e7d7bb61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.330763] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.330928] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.331090] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.331284] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fe12613-4be5-4b59-9116-6e8887356711" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.331654] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.331712] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.331901] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.337101] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.337101] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.337300] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.337356] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.337906] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.361985] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eee84844-ea79-48de-9294-c53a759dc328 in Status: IN_PROGRESS for 2s [ 1119.377532] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bb62eb06-eeb8-448e-a256-ef5cfef1b811 in Status: IN_PROGRESS for 2s [ 1119.417130] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.417130] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.417130] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.417130] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.417130] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.430402] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 47a435cb-d815-4f84-b215-41c82faf33b9 in Status: IN_PROGRESS for 2s [ 1119.512558] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.512927] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.512927] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.513012] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.513763] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.556206] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad5e0335-03f5-413e-88dc-5138f0daa778 in Status: IN_PROGRESS for 2s [ 1119.846095] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.846095] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.846095] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.846095] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.846095] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.846095] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 25d71d6e-f381-40cd-b3d0-6c5c495c4c87 already deleted. [ 1119.846095] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-25d71d6e-f381-40cd-b3d0-6c5c495c4c87" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.221194] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 in Status: SUCCESS [ 1120.221384] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 deletion is rescheduled due to dependency. [ 1120.221507] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.333737] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 in Status: SUCCESS [ 1120.334202] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 deletion is rescheduled due to dependency. [ 1120.334202] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.377332] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eee84844-ea79-48de-9294-c53a759dc328 in Status: SUCCESS [ 1121.377332] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.390054] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bb62eb06-eeb8-448e-a256-ef5cfef1b811 in Status: SUCCESS [ 1121.390325] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bb62eb06-eeb8-448e-a256-ef5cfef1b811" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.428065] env[70392]: INFO networking_nsxv3.common.synchronization [req-623ce3d1-20c6-4e20-8f18-c5189d57241f req-ed4054c1-e70d-4428-bf3a-00c85880f61e tempest-ImagesTestJSON-499820929 tempest-ImagesTestJSON-499820929-project-member] Enqueued Resource ID: bca01ddc-73d5-4856-bbff-aefad642492a with Priority: HIGHEST for action security_group_members [ 1121.429087] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bca01ddc-73d5-4856-bbff-aefad642492a with Priority: HIGHEST for action security_group_members [ 1121.429185] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-bca01ddc-73d5-4856-bbff-aefad642492a taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.429305] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.429373] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.430040] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.430040] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.430040] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.430040] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.430296] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.430405] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.430405] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bca01ddc-73d5-4856-bbff-aefad642492a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.448260] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 47a435cb-d815-4f84-b215-41c82faf33b9 in Status: SUCCESS [ 1121.448260] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.727026] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad5e0335-03f5-413e-88dc-5138f0daa778 in Status: SUCCESS [ 1121.727026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad5e0335-03f5-413e-88dc-5138f0daa778" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.934180] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bca01ddc-73d5-4856-bbff-aefad642492a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.436421] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bca01ddc-73d5-4856-bbff-aefad642492a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.939566] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.939781] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.939871] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.941774] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.941774] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.941774] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bca01ddc-73d5-4856-bbff-aefad642492a is going to be updated. [ 1122.980735] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.980735] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.980735] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.980735] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.980735] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.993300] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bca01ddc-73d5-4856-bbff-aefad642492a in Status: IN_PROGRESS for 2s [ 1123.969247] env[70392]: INFO networking_nsxv3.common.synchronization [req-a0bcd8a3-941b-4154-a764-ac229bc8639e req-4ab1b968-1e48-4fbc-b3e1-41a7103f87a6 tempest-ServerRescueNegativeTestJSON-197938596 tempest-ServerRescueNegativeTestJSON-197938596-project-member] Enqueued Resource ID: eee84844-ea79-48de-9294-c53a759dc328 with Priority: HIGHEST for action security_group_members [ 1123.969247] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eee84844-ea79-48de-9294-c53a759dc328 with Priority: HIGHEST for action security_group_members [ 1123.969247] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-eee84844-ea79-48de-9294-c53a759dc328 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.969247] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.969247] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.969247] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.971696] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.973307] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.973307] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.973307] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.973307] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.973307] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eee84844-ea79-48de-9294-c53a759dc328',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.246432] env[70392]: INFO networking_nsxv3.common.synchronization [req-ee7b4311-9fd3-464b-81af-90cb572ac3c3 req-e36446e7-959a-41d4-af07-78fcc1da49ab tempest-DeleteServersTestJSON-1676313022 tempest-DeleteServersTestJSON-1676313022-project-member] Enqueued Resource ID: ce79170a-31ce-429e-8e08-a911557872f4 with Priority: HIGHEST for action security_group_members [ 1124.247160] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce79170a-31ce-429e-8e08-a911557872f4 with Priority: HIGHEST for action security_group_members [ 1124.247441] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce79170a-31ce-429e-8e08-a911557872f4 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.247557] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.247639] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.247847] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.247998] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.248118] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.248181] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.248330] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.248438] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.248528] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce79170a-31ce-429e-8e08-a911557872f4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.479157] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.479157] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.479157] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.479157] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.479157] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.479157] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.479157] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.479157] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.479157] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.479157] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.479157] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eee84844-ea79-48de-9294-c53a759dc328 is going to be updated. [ 1124.513569] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.513569] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.513569] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.513569] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.513569] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.520751] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eee84844-ea79-48de-9294-c53a759dc328 in Status: IN_PROGRESS for 2s [ 1124.692289] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-422 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.692523] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-422" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.692750] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-422" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.693014] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-422" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.693779] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.693978] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.694152] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.694418] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.694639] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.694865] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1124.695045] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1124.695221] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1124.695359] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1124.695481] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1124.695639] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1124.695815] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1124.715261] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1124.715442] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1124.715675] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1124.715882] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-422" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.716228] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-99e1752d-767e-481a-848e-a9b57a47fb87 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.716406] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-99e1752d-767e-481a-848e-a9b57a47fb87" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.716540] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-99e1752d-767e-481a-848e-a9b57a47fb87" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.716885] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-99e1752d-767e-481a-848e-a9b57a47fb87" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.717045] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99e1752d-767e-481a-848e-a9b57a47fb87',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.750635] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.750792] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.750868] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.751101] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.751194] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.751392] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.751693] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.751693] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.751777] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.751860] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.751947] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce79170a-31ce-429e-8e08-a911557872f4 is going to be deleted. [ 1124.783147] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.783147] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.783353] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.783486] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.783592] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.783653] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.004580] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bca01ddc-73d5-4856-bbff-aefad642492a in Status: SUCCESS [ 1125.004858] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.219710] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.220019] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.220118] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.220396] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.220554] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.220716] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 99e1752d-767e-481a-848e-a9b57a47fb87 not found, creating... [ 1125.220994] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.221170] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.221292] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.221517] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.221662] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.221962] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.226148] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.226299] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.226573] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.226764] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.226938] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 99e1752d-767e-481a-848e-a9b57a47fb87 is going to be created. [ 1125.273282] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.273518] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.273643] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.273961] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.274317] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.274571] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-99e1752d-767e-481a-848e-a9b57a47fb87" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.762556] env[70392]: INFO networking_nsxv3.common.synchronization [None req-3ef14cb6-aee8-489f-9627-2eacb034808a None None] Enqueued Resource ID: 008e9f18-38ff-4b1e-abb5-ec6d068b2b1c with Priority: HIGHEST for action port [ 1125.763027] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 008e9f18-38ff-4b1e-abb5-ec6d068b2b1c with Priority: HIGHEST for action port [ 1125.763462] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-008e9f18-38ff-4b1e-abb5-ec6d068b2b1c taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.763615] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-008e9f18-38ff-4b1e-abb5-ec6d068b2b1c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.763687] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-008e9f18-38ff-4b1e-abb5-ec6d068b2b1c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.763941] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-008e9f18-38ff-4b1e-abb5-ec6d068b2b1c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.765546] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('008e9f18-38ff-4b1e-abb5-ec6d068b2b1c',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.061975] env[70392]: INFO networking_nsxv3.common.synchronization [req-ee7b4311-9fd3-464b-81af-90cb572ac3c3 req-a56c0eca-2492-4fc8-a4e8-7766bb754baf service nova] Enqueued Resource ID: ce79170a-31ce-429e-8e08-a911557872f4 with Priority: HIGHEST for action security_group_rules [ 1126.062232] env[70392]: INFO networking_nsxv3.common.synchronization [req-ee7b4311-9fd3-464b-81af-90cb572ac3c3 req-a56c0eca-2492-4fc8-a4e8-7766bb754baf service nova] Enqueued Resource ID: ce79170a-31ce-429e-8e08-a911557872f4 with Priority: HIGHEST for action security_group_members [ 1126.062744] env[70392]: INFO networking_nsxv3.common.synchronization [req-ee7b4311-9fd3-464b-81af-90cb572ac3c3 req-a56c0eca-2492-4fc8-a4e8-7766bb754baf service nova] Enqueued Resource ID: 99e1752d-767e-481a-848e-a9b57a47fb87 with Priority: HIGHEST for action port [ 1126.063367] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce79170a-31ce-429e-8e08-a911557872f4 with Priority: HIGHEST for action security_group_rules [ 1126.063545] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce79170a-31ce-429e-8e08-a911557872f4 with Priority: HIGHEST for action security_group_members [ 1126.063750] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99e1752d-767e-481a-848e-a9b57a47fb87 with Priority: HIGHEST for action port [ 1126.064076] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ce79170a-31ce-429e-8e08-a911557872f4 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.064742] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.064867] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.065129] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.065249] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ce79170a-31ce-429e-8e08-a911557872f4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.068182] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce79170a-31ce-429e-8e08-a911557872f4 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.068357] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.068484] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.068765] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.068931] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.069187] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.069187] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.069333] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.069454] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.069566] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce79170a-31ce-429e-8e08-a911557872f4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.070702] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-99e1752d-767e-481a-848e-a9b57a47fb87 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.070702] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-99e1752d-767e-481a-848e-a9b57a47fb87" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.070821] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-99e1752d-767e-481a-848e-a9b57a47fb87" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.070978] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-99e1752d-767e-481a-848e-a9b57a47fb87" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.071073] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99e1752d-767e-481a-848e-a9b57a47fb87',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.268895] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 008e9f18-38ff-4b1e-abb5-ec6d068b2b1c [ 1126.269174] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.269311] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.269381] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.269602] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.269695] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.269793] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:008e9f18-38ff-4b1e-abb5-ec6d068b2b1c already deleted. [ 1126.269876] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-008e9f18-38ff-4b1e-abb5-ec6d068b2b1c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.533417] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eee84844-ea79-48de-9294-c53a759dc328 in Status: SUCCESS [ 1126.533803] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eee84844-ea79-48de-9294-c53a759dc328 deletion is rescheduled due to dependency. [ 1126.534173] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.572999] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce79170a-31ce-429e-8e08-a911557872f4 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.573164] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.573418] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ce79170a-31ce-429e-8e08-a911557872f4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.577068] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 99e1752d-767e-481a-848e-a9b57a47fb87 with status ACTIVE [ 1126.577292] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.577662] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.577662] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.577794] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.577794] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.578137] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.578337] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.578337] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.579391] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.579391] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.579391] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.579391] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.579391] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.583099] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.583253] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.583342] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 99e1752d-767e-481a-848e-a9b57a47fb87 is going to be updated. [ 1126.607976] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.608291] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.608291] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.608408] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.608539] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.608708] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-99e1752d-767e-481a-848e-a9b57a47fb87" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.841566] env[70392]: INFO networking_nsxv3.common.synchronization [req-95d5dd9f-fbdb-4b14-bb66-33c53fe2355f req-a043c27b-8e2b-4be7-a8dd-fa257f68b1a0 tempest-AttachInterfacesTestJSON-2046649887 tempest-AttachInterfacesTestJSON-2046649887-project-member] Enqueued Resource ID: 73f697c6-7f54-4f76-8856-ccf1651be1c2 with Priority: HIGHEST for action security_group_members [ 1126.841566] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73f697c6-7f54-4f76-8856-ccf1651be1c2 with Priority: HIGHEST for action security_group_members [ 1126.841566] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-73f697c6-7f54-4f76-8856-ccf1651be1c2 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.841566] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73f697c6-7f54-4f76-8856-ccf1651be1c2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.841566] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73f697c6-7f54-4f76-8856-ccf1651be1c2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.841566] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73f697c6-7f54-4f76-8856-ccf1651be1c2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.842533] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.842811] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.843050] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.843607] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.843797] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.843977] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('73f697c6-7f54-4f76-8856-ccf1651be1c2',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.076174] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ce79170a-31ce-429e-8e08-a911557872f4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.343857] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-328 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.344015] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.344080] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.344300] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.344559] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.345161] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.345161] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.345365] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.345693] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.345767] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1127.345887] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1127.346008] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1127.346122] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1127.346248] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1127.346398] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1127.346482] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1127.348284] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.348399] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.348470] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.348631] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.348716] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.348893] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.348988] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.351315] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.351315] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.351315] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.351315] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73f697c6-7f54-4f76-8856-ccf1651be1c2 already deleted. [ 1127.351315] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73f697c6-7f54-4f76-8856-ccf1651be1c2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.368722] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1127.368970] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1127.369171] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1127.369366] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.369666] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-f1392dc7-6a54-435d-9d3e-c00e8412d126 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.369845] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-f1392dc7-6a54-435d-9d3e-c00e8412d126" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.369968] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-f1392dc7-6a54-435d-9d3e-c00e8412d126" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.370303] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-f1392dc7-6a54-435d-9d3e-c00e8412d126" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.370451] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1392dc7-6a54-435d-9d3e-c00e8412d126',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.578376] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.578520] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.578579] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.578797] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.578889] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.579025] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce79170a-31ce-429e-8e08-a911557872f4 is going to be created. [ 1127.604080] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.604317] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.604411] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.604632] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.604803] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.616719] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce79170a-31ce-429e-8e08-a911557872f4 in Status: UNINITIALIZED for 2s [ 1127.876148] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.876398] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.876508] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.876852] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.877027] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.877195] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port f1392dc7-6a54-435d-9d3e-c00e8412d126 not found, creating... [ 1127.877558] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.877740] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.877867] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.878127] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.878276] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.878665] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.878847] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.878968] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.882120] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.882120] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.882120] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: f1392dc7-6a54-435d-9d3e-c00e8412d126 is going to be created. [ 1127.902432] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.902572] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.902666] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.903799] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.903799] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.903799] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-f1392dc7-6a54-435d-9d3e-c00e8412d126" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.101691] env[70392]: INFO networking_nsxv3.common.synchronization [None req-8e661e93-6d1d-4d00-b6d8-1054ac881d8f None None] Enqueued Resource ID: 5fb87e2b-068e-423f-a9b6-5828e06b948b with Priority: HIGHEST for action port [ 1128.102162] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fb87e2b-068e-423f-a9b6-5828e06b948b with Priority: HIGHEST for action port [ 1128.102561] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-5fb87e2b-068e-423f-a9b6-5828e06b948b taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.102718] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5fb87e2b-068e-423f-a9b6-5828e06b948b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.102822] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5fb87e2b-068e-423f-a9b6-5828e06b948b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.103125] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5fb87e2b-068e-423f-a9b6-5828e06b948b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.103262] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5fb87e2b-068e-423f-a9b6-5828e06b948b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.606168] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5fb87e2b-068e-423f-a9b6-5828e06b948b [ 1128.606696] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.606985] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.607179] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.609191] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.609191] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.609191] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5fb87e2b-068e-423f-a9b6-5828e06b948b already deleted. [ 1128.609191] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5fb87e2b-068e-423f-a9b6-5828e06b948b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.759902] env[70392]: INFO networking_nsxv3.common.synchronization [req-95d5dd9f-fbdb-4b14-bb66-33c53fe2355f req-1752b5fe-18b3-4838-a695-3ab4647f57dc service nova] Enqueued Resource ID: 73f697c6-7f54-4f76-8856-ccf1651be1c2 with Priority: HIGHEST for action security_group_rules [ 1128.759902] env[70392]: INFO networking_nsxv3.common.synchronization [req-95d5dd9f-fbdb-4b14-bb66-33c53fe2355f req-1752b5fe-18b3-4838-a695-3ab4647f57dc service nova] Enqueued Resource ID: 73f697c6-7f54-4f76-8856-ccf1651be1c2 with Priority: HIGHEST for action security_group_members [ 1128.759902] env[70392]: INFO networking_nsxv3.common.synchronization [req-95d5dd9f-fbdb-4b14-bb66-33c53fe2355f req-1752b5fe-18b3-4838-a695-3ab4647f57dc service nova] Enqueued Resource ID: f1392dc7-6a54-435d-9d3e-c00e8412d126 with Priority: HIGHEST for action port [ 1128.759902] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73f697c6-7f54-4f76-8856-ccf1651be1c2 with Priority: HIGHEST for action security_group_rules [ 1128.759902] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73f697c6-7f54-4f76-8856-ccf1651be1c2 with Priority: HIGHEST for action security_group_members [ 1128.759902] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1392dc7-6a54-435d-9d3e-c00e8412d126 with Priority: HIGHEST for action port [ 1128.759902] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-73f697c6-7f54-4f76-8856-ccf1651be1c2 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.759902] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-73f697c6-7f54-4f76-8856-ccf1651be1c2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.759902] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-73f697c6-7f54-4f76-8856-ccf1651be1c2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.759902] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-73f697c6-7f54-4f76-8856-ccf1651be1c2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.762479] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('73f697c6-7f54-4f76-8856-ccf1651be1c2',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.763051] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-73f697c6-7f54-4f76-8856-ccf1651be1c2 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.763194] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73f697c6-7f54-4f76-8856-ccf1651be1c2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.763264] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73f697c6-7f54-4f76-8856-ccf1651be1c2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.763458] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73f697c6-7f54-4f76-8856-ccf1651be1c2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.763618] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.763713] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.763775] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.763916] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.764010] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.764106] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('73f697c6-7f54-4f76-8856-ccf1651be1c2',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.764926] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-f1392dc7-6a54-435d-9d3e-c00e8412d126 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.767759] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f1392dc7-6a54-435d-9d3e-c00e8412d126" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.767759] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f1392dc7-6a54-435d-9d3e-c00e8412d126" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.770026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f1392dc7-6a54-435d-9d3e-c00e8412d126" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.770026] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1392dc7-6a54-435d-9d3e-c00e8412d126',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.270467] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-73f697c6-7f54-4f76-8856-ccf1651be1c2 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.271031] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73f697c6-7f54-4f76-8856-ccf1651be1c2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.271031] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('73f697c6-7f54-4f76-8856-ccf1651be1c2',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.273522] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f1392dc7-6a54-435d-9d3e-c00e8412d126 with status ACTIVE [ 1129.273522] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.273522] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.273522] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.273522] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.273522] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.273522] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.274962] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.274962] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.275121] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.275315] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.277038] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.277038] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.277038] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.277038] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.277038] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.277038] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f1392dc7-6a54-435d-9d3e-c00e8412d126 is going to be updated. [ 1129.299900] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.301110] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.301110] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.301110] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.301766] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.301766] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f1392dc7-6a54-435d-9d3e-c00e8412d126" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.633160] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce79170a-31ce-429e-8e08-a911557872f4 in Status: SUCCESS [ 1129.633415] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.633656] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.634421] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.634421] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.634421] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.634421] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.634637] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.634711] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.634896] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.634896] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ce79170a-31ce-429e-8e08-a911557872f4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.781132] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('73f697c6-7f54-4f76-8856-ccf1651be1c2',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.137379] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce79170a-31ce-429e-8e08-a911557872f4 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.137379] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.137379] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.137598] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.138768] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.138768] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.138768] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.138768] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.138768] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.138768] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.138768] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce79170a-31ce-429e-8e08-a911557872f4 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.138768] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.138768] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.139229] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.139229] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.139229] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.139229] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.139384] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.139464] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.139546] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.139644] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ce79170a-31ce-429e-8e08-a911557872f4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.281950] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.282360] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.282360] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.286229] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.286428] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.286428] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73f697c6-7f54-4f76-8856-ccf1651be1c2 is going to be created. [ 1130.319762] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.319904] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.319904] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.320130] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.320282] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.331887] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73f697c6-7f54-4f76-8856-ccf1651be1c2 in Status: UNINITIALIZED for 2s [ 1130.641731] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ce79170a-31ce-429e-8e08-a911557872f4: rpc.has_security_group_logging(os_id): False [ 1130.661490] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.661647] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.661742] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.661935] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.662076] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.662321] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.662427] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.662491] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.662665] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.662740] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.662915] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.663015] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.663079] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.663233] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.663295] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.663643] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.663713] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.663713] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.663865] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.664068] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.664173] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ce79170a-31ce-429e-8e08-a911557872f4 is going to be created. [ 1130.780101] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.780292] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.780463] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.780638] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.780865] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.797327] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ce79170a-31ce-429e-8e08-a911557872f4 in Status: IN_PROGRESS for 2s [ 1132.347637] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73f697c6-7f54-4f76-8856-ccf1651be1c2 in Status: SUCCESS [ 1132.347637] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73f697c6-7f54-4f76-8856-ccf1651be1c2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.348054] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73f697c6-7f54-4f76-8856-ccf1651be1c2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.348054] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73f697c6-7f54-4f76-8856-ccf1651be1c2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.348252] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.349199] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.349199] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.349199] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.349199] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.349199] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73f697c6-7f54-4f76-8856-ccf1651be1c2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.349199] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('73f697c6-7f54-4f76-8856-ccf1651be1c2',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.812605] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ce79170a-31ce-429e-8e08-a911557872f4 in Status: SUCCESS [ 1132.812829] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.851595] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('73f697c6-7f54-4f76-8856-ccf1651be1c2',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.354493] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 73f697c6-7f54-4f76-8856-ccf1651be1c2: rpc.has_security_group_logging(os_id): False [ 1133.372621] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.372805] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.372805] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.373569] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.373569] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.373569] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.373569] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.373569] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.373806] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.373806] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.373867] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 73f697c6-7f54-4f76-8856-ccf1651be1c2 is going to be created. [ 1133.437962] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.438167] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.438224] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.438430] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.438637] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.452871] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 73f697c6-7f54-4f76-8856-ccf1651be1c2 in Status: IN_PROGRESS for 2s [ 1133.760027] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1133.760230] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1135.467893] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 73f697c6-7f54-4f76-8856-ccf1651be1c2 in Status: SUCCESS [ 1135.467893] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-73f697c6-7f54-4f76-8856-ccf1651be1c2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.574184] env[70392]: INFO networking_nsxv3.common.synchronization [req-57027e38-1652-43e8-b054-bb8dffa039ea req-c63eb39e-ce61-4112-8b78-eeb1efa9668d tempest-DeleteServersTestJSON-1676313022 tempest-DeleteServersTestJSON-1676313022-project-member] Enqueued Resource ID: ce79170a-31ce-429e-8e08-a911557872f4 with Priority: HIGHEST for action security_group_members [ 1138.574699] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce79170a-31ce-429e-8e08-a911557872f4 with Priority: HIGHEST for action security_group_members [ 1138.575250] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce79170a-31ce-429e-8e08-a911557872f4 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.575250] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.575250] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.575418] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.575547] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.575641] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.575762] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.575939] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.576036] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.576135] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce79170a-31ce-429e-8e08-a911557872f4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.078418] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.078594] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.078676] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.078902] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.079045] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.079755] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.079755] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.079755] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.079755] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.079755] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.079755] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce79170a-31ce-429e-8e08-a911557872f4 is going to be updated. [ 1139.109184] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.109342] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.109415] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.109629] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.109773] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.119408] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce79170a-31ce-429e-8e08-a911557872f4 in Status: IN_PROGRESS for 2s [ 1141.131983] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce79170a-31ce-429e-8e08-a911557872f4 in Status: IN_PROGRESS for 4s [ 1143.148022] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce79170a-31ce-429e-8e08-a911557872f4 in Status: SUCCESS [ 1143.148022] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce79170a-31ce-429e-8e08-a911557872f4 deletion is rescheduled due to dependency. [ 1143.148022] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.577168] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1143.577297] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1144.467136] env[70392]: INFO networking_nsxv3.common.synchronization [req-971e90b3-9ca5-4159-8920-a757d2a488b9 req-191c60f2-09b2-4cf3-bdda-9ae2fa551643 tempest-ServersV294TestFqdnHostnames-287335487 tempest-ServersV294TestFqdnHostnames-287335487-project-member] Enqueued Resource ID: ad5e0335-03f5-413e-88dc-5138f0daa778 with Priority: HIGHEST for action security_group_members [ 1144.467678] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad5e0335-03f5-413e-88dc-5138f0daa778 with Priority: HIGHEST for action security_group_members [ 1144.467987] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad5e0335-03f5-413e-88dc-5138f0daa778 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.469856] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad5e0335-03f5-413e-88dc-5138f0daa778" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.469984] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad5e0335-03f5-413e-88dc-5138f0daa778" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.470261] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad5e0335-03f5-413e-88dc-5138f0daa778" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.470452] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.470598] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.470697] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.470893] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.471036] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.471193] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad5e0335-03f5-413e-88dc-5138f0daa778',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.973760] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.974085] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.974182] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.974412] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.974511] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.974718] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.974824] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.974890] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.975151] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.975151] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.975262] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad5e0335-03f5-413e-88dc-5138f0daa778 is going to be updated. [ 1144.998784] env[70392]: INFO networking_nsxv3.common.synchronization [req-8523284e-3acc-43de-8bef-e7f13a7e5210 req-b89b997a-8252-4ee4-ab50-2320ad96d1d7 tempest-ServersTestJSON-507292717 tempest-ServersTestJSON-507292717-project-member] Enqueued Resource ID: 19062702-bd29-4477-a732-5169f347b4da with Priority: HIGHEST for action security_group_members [ 1144.998878] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19062702-bd29-4477-a732-5169f347b4da with Priority: HIGHEST for action security_group_members [ 1144.999158] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-19062702-bd29-4477-a732-5169f347b4da taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.999280] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.999347] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.999545] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.999695] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.999790] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.999855] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.000010] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.000129] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.000225] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.007473] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.007473] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.007473] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.007473] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.007473] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.029420] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad5e0335-03f5-413e-88dc-5138f0daa778 in Status: IN_PROGRESS for 2s [ 1145.502809] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.540524] env[70392]: INFO networking_nsxv3.common.synchronization [None req-ac8e5540-fbcb-49c5-a9e5-d7c80f1fcf85 None None] Enqueued Resource ID: dd010753-b333-4355-a5d1-3a4e5c59dd40 with Priority: HIGHEST for action port [ 1145.541178] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd010753-b333-4355-a5d1-3a4e5c59dd40 with Priority: HIGHEST for action port [ 1145.541465] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-dd010753-b333-4355-a5d1-3a4e5c59dd40 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.541552] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dd010753-b333-4355-a5d1-3a4e5c59dd40" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.541552] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dd010753-b333-4355-a5d1-3a4e5c59dd40" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.541782] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dd010753-b333-4355-a5d1-3a4e5c59dd40" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.542303] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd010753-b333-4355-a5d1-3a4e5c59dd40',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.937818] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-219 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.937818] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-219" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.937818] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-219" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.937818] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-219" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.937818] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.937818] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.937818] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.938801] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.939116] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.939686] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1145.940034] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1145.944041] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1145.944041] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1145.944041] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1145.944041] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1145.944041] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1145.962107] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1145.962882] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1145.963112] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1145.963343] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-219" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.963699] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-2253a512-d3d4-4030-884f-ea09054c5377 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.964875] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-2253a512-d3d4-4030-884f-ea09054c5377" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.966418] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-2253a512-d3d4-4030-884f-ea09054c5377" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.966418] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-2253a512-d3d4-4030-884f-ea09054c5377" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.966418] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2253a512-d3d4-4030-884f-ea09054c5377',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.007288] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.045793] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dd010753-b333-4355-a5d1-3a4e5c59dd40 [ 1146.045793] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.045793] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.045793] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.045793] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.045793] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.045793] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dd010753-b333-4355-a5d1-3a4e5c59dd40 already deleted. [ 1146.045793] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dd010753-b333-4355-a5d1-3a4e5c59dd40" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.469144] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.469144] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.469144] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.469144] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.473232] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.473232] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 2253a512-d3d4-4030-884f-ea09054c5377 not found, creating... [ 1146.473232] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.473232] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.473232] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.473232] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.473232] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.474518] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.474896] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.475158] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.475561] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.476379] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.476680] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 2253a512-d3d4-4030-884f-ea09054c5377 is going to be created. [ 1146.502047] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.502047] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.502047] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.502325] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.502582] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.502837] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-2253a512-d3d4-4030-884f-ea09054c5377" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.510616] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.510616] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.510616] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.510616] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.510616] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.510616] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19062702-bd29-4477-a732-5169f347b4da is going to be updated. [ 1146.545257] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.545411] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.545483] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.545686] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.545829] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.556671] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19062702-bd29-4477-a732-5169f347b4da in Status: IN_PROGRESS for 2s [ 1147.039839] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad5e0335-03f5-413e-88dc-5138f0daa778 in Status: SUCCESS [ 1147.040910] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad5e0335-03f5-413e-88dc-5138f0daa778 deletion is rescheduled due to dependency. [ 1147.040910] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad5e0335-03f5-413e-88dc-5138f0daa778" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.384411] env[70392]: INFO networking_nsxv3.common.synchronization [req-8523284e-3acc-43de-8bef-e7f13a7e5210 req-66705a8b-879f-4701-9ace-a8ac233da545 service nova] Enqueued Resource ID: 19062702-bd29-4477-a732-5169f347b4da with Priority: HIGHEST for action security_group_rules [ 1147.384594] env[70392]: INFO networking_nsxv3.common.synchronization [req-8523284e-3acc-43de-8bef-e7f13a7e5210 req-66705a8b-879f-4701-9ace-a8ac233da545 service nova] Enqueued Resource ID: 19062702-bd29-4477-a732-5169f347b4da with Priority: HIGHEST for action security_group_members [ 1147.384737] env[70392]: INFO networking_nsxv3.common.synchronization [req-8523284e-3acc-43de-8bef-e7f13a7e5210 req-66705a8b-879f-4701-9ace-a8ac233da545 service nova] Enqueued Resource ID: 2253a512-d3d4-4030-884f-ea09054c5377 with Priority: HIGHEST for action port [ 1147.384968] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19062702-bd29-4477-a732-5169f347b4da with Priority: HIGHEST for action security_group_rules [ 1147.385109] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19062702-bd29-4477-a732-5169f347b4da with Priority: HIGHEST for action security_group_members [ 1147.385206] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2253a512-d3d4-4030-884f-ea09054c5377 with Priority: HIGHEST for action port [ 1147.385743] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-19062702-bd29-4477-a732-5169f347b4da taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.386148] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.386148] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.386266] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.386266] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.387046] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-19062702-bd29-4477-a732-5169f347b4da taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.387173] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.387389] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-2253a512-d3d4-4030-884f-ea09054c5377 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.388232] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2253a512-d3d4-4030-884f-ea09054c5377" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.388232] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2253a512-d3d4-4030-884f-ea09054c5377" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.388232] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2253a512-d3d4-4030-884f-ea09054c5377" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.388232] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2253a512-d3d4-4030-884f-ea09054c5377',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.775862] env[70392]: INFO networking_nsxv3.common.synchronization [None req-ae6787d1-6936-4058-813c-34d3af7c0100 None None] Enqueued Resource ID: 12f30df0-7a3e-4453-8ebe-704e7332a31b with Priority: HIGHEST for action port [ 1147.776197] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12f30df0-7a3e-4453-8ebe-704e7332a31b with Priority: HIGHEST for action port [ 1147.777432] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-12f30df0-7a3e-4453-8ebe-704e7332a31b taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.777432] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12f30df0-7a3e-4453-8ebe-704e7332a31b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.777432] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12f30df0-7a3e-4453-8ebe-704e7332a31b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.777432] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12f30df0-7a3e-4453-8ebe-704e7332a31b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.777432] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12f30df0-7a3e-4453-8ebe-704e7332a31b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.889970] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-19062702-bd29-4477-a732-5169f347b4da taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.890118] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.890312] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2253a512-d3d4-4030-884f-ea09054c5377 with status ACTIVE [ 1147.890478] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.890583] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.890645] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.890854] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.890941] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.891124] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.891217] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.891281] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.891430] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.891504] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.891679] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.891766] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.891824] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.891960] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.892058] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.892587] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2253a512-d3d4-4030-884f-ea09054c5377 is going to be updated. [ 1147.914590] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.914590] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.914590] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.914775] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.914775] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.914941] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2253a512-d3d4-4030-884f-ea09054c5377" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.283762] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 12f30df0-7a3e-4453-8ebe-704e7332a31b [ 1148.283762] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.283762] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.283762] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.284037] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.284161] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.285591] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:12f30df0-7a3e-4453-8ebe-704e7332a31b already deleted. [ 1148.285591] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12f30df0-7a3e-4453-8ebe-704e7332a31b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.571573] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19062702-bd29-4477-a732-5169f347b4da in Status: SUCCESS [ 1148.571573] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.571573] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.571573] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.571573] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.571573] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.571573] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.571573] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.571573] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.571573] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.816781] env[70392]: INFO networking_nsxv3.common.synchronization [req-58d7d43f-a155-4c9f-b0c0-589105415733 req-20aafd59-3de1-4067-b871-fd6237595ef0 tempest-ServerDiskConfigTestJSON-277542510 tempest-ServerDiskConfigTestJSON-277542510-project-member] Enqueued Resource ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 with Priority: HIGHEST for action security_group_members [ 1148.816781] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 with Priority: HIGHEST for action security_group_members [ 1148.816781] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60d7eaa-9583-4c75-97fa-4049c63576b6 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.816781] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.816781] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.816781] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.818099] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.818363] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.818530] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.818802] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.818999] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.819307] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b60d7eaa-9583-4c75-97fa-4049c63576b6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.076760] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.248089] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-256 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.248297] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-256" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.248424] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-256" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.248689] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-256" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.248944] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.249110] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.249474] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.249474] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.249622] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.249825] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1149.249943] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1149.250091] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1149.250212] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1149.250332] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1149.250441] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1149.250587] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1149.269019] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1149.269234] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1149.269391] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1149.269684] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-256" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.269964] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-c48abd56-505e-4781-bcd5-04c59a7dc298 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.270218] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-c48abd56-505e-4781-bcd5-04c59a7dc298" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.270306] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-c48abd56-505e-4781-bcd5-04c59a7dc298" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.270641] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-c48abd56-505e-4781-bcd5-04c59a7dc298" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.270843] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c48abd56-505e-4781-bcd5-04c59a7dc298',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.321891] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.322074] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.322120] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.322335] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.322424] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.322893] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.323066] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.323136] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.323295] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.323374] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.323468] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 is going to be updated. [ 1149.349302] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.352778] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.352778] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.352778] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.352778] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.362913] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 in Status: IN_PROGRESS for 2s [ 1149.579390] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.773309] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.774074] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.774239] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.774537] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.774696] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.774860] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port c48abd56-505e-4781-bcd5-04c59a7dc298 not found, creating... [ 1149.775159] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.775334] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.775455] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.775686] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.775829] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.776306] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.776542] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.776729] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.776994] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.777248] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.777446] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: c48abd56-505e-4781-bcd5-04c59a7dc298 is going to be created. [ 1149.800303] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.800531] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.800666] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.800942] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.801246] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.801498] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-c48abd56-505e-4781-bcd5-04c59a7dc298" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.083070] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.083487] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.083487] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.083601] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.083704] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.083815] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19062702-bd29-4477-a732-5169f347b4da is going to be updated. [ 1150.114756] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.114865] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.114865] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.115141] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.115279] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.134213] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19062702-bd29-4477-a732-5169f347b4da in Status: IN_PROGRESS for 2s [ 1150.584211] env[70392]: INFO networking_nsxv3.common.synchronization [req-58d7d43f-a155-4c9f-b0c0-589105415733 req-ce2cc1f2-da89-4146-8667-11a7b102d851 service nova] Enqueued Resource ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 with Priority: HIGHEST for action security_group_rules [ 1150.584211] env[70392]: INFO networking_nsxv3.common.synchronization [req-58d7d43f-a155-4c9f-b0c0-589105415733 req-ce2cc1f2-da89-4146-8667-11a7b102d851 service nova] Enqueued Resource ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 with Priority: HIGHEST for action security_group_members [ 1150.584211] env[70392]: INFO networking_nsxv3.common.synchronization [req-58d7d43f-a155-4c9f-b0c0-589105415733 req-ce2cc1f2-da89-4146-8667-11a7b102d851 service nova] Enqueued Resource ID: c48abd56-505e-4781-bcd5-04c59a7dc298 with Priority: HIGHEST for action port [ 1150.584211] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 with Priority: HIGHEST for action security_group_rules [ 1150.586951] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 with Priority: HIGHEST for action security_group_members [ 1150.587138] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c48abd56-505e-4781-bcd5-04c59a7dc298 with Priority: HIGHEST for action port [ 1150.587447] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b60d7eaa-9583-4c75-97fa-4049c63576b6 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.587571] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.587633] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.587846] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.587924] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b60d7eaa-9583-4c75-97fa-4049c63576b6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.589067] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60d7eaa-9583-4c75-97fa-4049c63576b6 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.589153] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.589376] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-c48abd56-505e-4781-bcd5-04c59a7dc298 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.589508] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c48abd56-505e-4781-bcd5-04c59a7dc298" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.589597] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c48abd56-505e-4781-bcd5-04c59a7dc298" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.589750] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c48abd56-505e-4781-bcd5-04c59a7dc298" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.589824] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c48abd56-505e-4781-bcd5-04c59a7dc298',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.091666] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60d7eaa-9583-4c75-97fa-4049c63576b6 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.091666] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.092061] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c48abd56-505e-4781-bcd5-04c59a7dc298 with status ACTIVE [ 1151.092061] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.092061] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.092189] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.092412] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.092504] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.092721] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.092850] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.092934] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.093124] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.093232] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.093439] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.093560] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.093640] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.093815] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.093915] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.094015] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c48abd56-505e-4781-bcd5-04c59a7dc298 is going to be updated. [ 1151.117303] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.117502] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.117543] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.117738] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.117876] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.118051] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c48abd56-505e-4781-bcd5-04c59a7dc298" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.377337] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 in Status: SUCCESS [ 1151.377337] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 deletion is rescheduled due to dependency. [ 1151.377777] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.377777] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.377777] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.378616] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.378616] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.378616] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.378616] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.378616] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.378616] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b60d7eaa-9583-4c75-97fa-4049c63576b6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.884064] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b60d7eaa-9583-4c75-97fa-4049c63576b6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.145404] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19062702-bd29-4477-a732-5169f347b4da in Status: SUCCESS [ 1152.146161] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.146161] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.146161] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.146348] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.146426] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.146750] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.146750] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.147948] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.147948] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.147948] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.386984] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b60d7eaa-9583-4c75-97fa-4049c63576b6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.416424] env[70392]: INFO networking_nsxv3.common.synchronization [req-e51f17d6-341a-46d1-a9d1-9edfc0849879 req-9da247a7-3ef2-4ed8-b6b6-ddcd6810301c tempest-AttachVolumeNegativeTest-772339566 tempest-AttachVolumeNegativeTest-772339566-project-member] Enqueued Resource ID: 25d71d6e-f381-40cd-b3d0-6c5c495c4c87 with Priority: HIGHEST for action security_group_members [ 1152.418371] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25d71d6e-f381-40cd-b3d0-6c5c495c4c87 with Priority: HIGHEST for action security_group_members [ 1152.418371] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-25d71d6e-f381-40cd-b3d0-6c5c495c4c87 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.418371] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25d71d6e-f381-40cd-b3d0-6c5c495c4c87" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.418371] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25d71d6e-f381-40cd-b3d0-6c5c495c4c87" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.418371] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25d71d6e-f381-40cd-b3d0-6c5c495c4c87" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.418371] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.418371] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.418371] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.418371] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.418371] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.418371] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25d71d6e-f381-40cd-b3d0-6c5c495c4c87',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.649264] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-19062702-bd29-4477-a732-5169f347b4da taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.649434] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.649508] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.649721] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.649893] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.649995] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.650074] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.650296] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.650403] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.650477] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.650628] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-19062702-bd29-4477-a732-5169f347b4da taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.650721] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.650782] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.650924] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.651076] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.651173] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.651235] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.651365] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.651455] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.651544] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.651635] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.892224] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.892630] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.892748] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.893195] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.893346] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.893651] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 is going to be updated. [ 1152.924551] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.924757] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.924799] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.925015] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.925137] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.925343] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.925443] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.926044] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.926044] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.926044] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.926044] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25d71d6e-f381-40cd-b3d0-6c5c495c4c87 already deleted. [ 1152.926044] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25d71d6e-f381-40cd-b3d0-6c5c495c4c87" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.944686] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.945121] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.945200] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.945455] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.945628] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.956117] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 in Status: IN_PROGRESS for 2s [ 1153.038873] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-483 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.038873] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-483" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.039192] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-483" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.043021] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-483" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.043021] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.043021] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.043509] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.044884] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.045090] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.045493] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1153.045493] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1153.045899] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1153.046167] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1153.046416] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1153.046812] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1153.047189] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1153.071160] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1153.071160] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1153.071292] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1153.071499] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-483" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.071814] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-60cace41-0844-4cd2-a449-ebc03dc269a1 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.072042] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-60cace41-0844-4cd2-a449-ebc03dc269a1" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.072199] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-60cace41-0844-4cd2-a449-ebc03dc269a1" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.072527] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-60cace41-0844-4cd2-a449-ebc03dc269a1" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.072665] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60cace41-0844-4cd2-a449-ebc03dc269a1',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.157151] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 19062702-bd29-4477-a732-5169f347b4da: rpc.has_security_group_logging(os_id): False [ 1153.183073] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.183073] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.183073] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.183073] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.208082] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.208082] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.208082] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.208082] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.208082] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.208082] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.208082] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.208082] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.208082] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.208082] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.208082] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.208082] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.208082] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.208082] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.208594] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.208594] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.208594] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 19062702-bd29-4477-a732-5169f347b4da is going to be updated. [ 1153.293028] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.293028] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.293028] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.293028] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.293028] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.311162] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 19062702-bd29-4477-a732-5169f347b4da in Status: IN_PROGRESS for 2s [ 1153.578952] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.579357] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.579609] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.580091] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.580308] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.580613] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 60cace41-0844-4cd2-a449-ebc03dc269a1 not found, creating... [ 1153.581131] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.582660] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.582849] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.583263] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.584141] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.584514] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.584923] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.584923] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.585087] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.585229] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.585383] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 60cace41-0844-4cd2-a449-ebc03dc269a1 is going to be created. [ 1153.607414] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.607555] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.607714] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.608069] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.608487] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.609968] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-60cace41-0844-4cd2-a449-ebc03dc269a1" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.452277] env[70392]: INFO networking_nsxv3.common.synchronization [req-e51f17d6-341a-46d1-a9d1-9edfc0849879 req-de47f5dc-cd69-43c2-993a-cc3a0fe0805a service nova] Enqueued Resource ID: 25d71d6e-f381-40cd-b3d0-6c5c495c4c87 with Priority: HIGHEST for action security_group_rules [ 1154.452277] env[70392]: INFO networking_nsxv3.common.synchronization [req-e51f17d6-341a-46d1-a9d1-9edfc0849879 req-de47f5dc-cd69-43c2-993a-cc3a0fe0805a service nova] Enqueued Resource ID: 25d71d6e-f381-40cd-b3d0-6c5c495c4c87 with Priority: HIGHEST for action security_group_members [ 1154.452277] env[70392]: INFO networking_nsxv3.common.synchronization [req-e51f17d6-341a-46d1-a9d1-9edfc0849879 req-de47f5dc-cd69-43c2-993a-cc3a0fe0805a service nova] Enqueued Resource ID: 60cace41-0844-4cd2-a449-ebc03dc269a1 with Priority: HIGHEST for action port [ 1154.452277] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25d71d6e-f381-40cd-b3d0-6c5c495c4c87 with Priority: HIGHEST for action security_group_rules [ 1154.452277] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25d71d6e-f381-40cd-b3d0-6c5c495c4c87 with Priority: HIGHEST for action security_group_members [ 1154.452667] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60cace41-0844-4cd2-a449-ebc03dc269a1 with Priority: HIGHEST for action port [ 1154.453307] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-25d71d6e-f381-40cd-b3d0-6c5c495c4c87 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.453418] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-25d71d6e-f381-40cd-b3d0-6c5c495c4c87" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.453506] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-25d71d6e-f381-40cd-b3d0-6c5c495c4c87" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.453971] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-25d71d6e-f381-40cd-b3d0-6c5c495c4c87" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.454186] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('25d71d6e-f381-40cd-b3d0-6c5c495c4c87',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.455115] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-25d71d6e-f381-40cd-b3d0-6c5c495c4c87 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.455263] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25d71d6e-f381-40cd-b3d0-6c5c495c4c87" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.455418] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25d71d6e-f381-40cd-b3d0-6c5c495c4c87" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.455504] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25d71d6e-f381-40cd-b3d0-6c5c495c4c87" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.455656] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.455750] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.455812] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.456263] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.456380] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.456474] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25d71d6e-f381-40cd-b3d0-6c5c495c4c87',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.457936] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-60cace41-0844-4cd2-a449-ebc03dc269a1 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.458051] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-60cace41-0844-4cd2-a449-ebc03dc269a1" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.458308] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-60cace41-0844-4cd2-a449-ebc03dc269a1" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.458696] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-60cace41-0844-4cd2-a449-ebc03dc269a1" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.458696] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60cace41-0844-4cd2-a449-ebc03dc269a1',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.935875] env[70392]: INFO networking_nsxv3.common.synchronization [req-571a234a-7cf8-4a32-8a4c-3a3e3a55d93c req-aa1c3927-692d-4e6f-bc59-8d6134a873b6 tempest-ImagesTestJSON-499820929 tempest-ImagesTestJSON-499820929-project-member] Enqueued Resource ID: bca01ddc-73d5-4856-bbff-aefad642492a with Priority: HIGHEST for action security_group_members [ 1154.936705] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bca01ddc-73d5-4856-bbff-aefad642492a with Priority: HIGHEST for action security_group_members [ 1154.937073] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-bca01ddc-73d5-4856-bbff-aefad642492a taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.937073] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.937073] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.937467] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.937629] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.937736] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.937799] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.937967] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.938061] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.938159] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bca01ddc-73d5-4856-bbff-aefad642492a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.960510] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-25d71d6e-f381-40cd-b3d0-6c5c495c4c87 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.960665] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25d71d6e-f381-40cd-b3d0-6c5c495c4c87" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.962609] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('25d71d6e-f381-40cd-b3d0-6c5c495c4c87',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.962609] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 60cace41-0844-4cd2-a449-ebc03dc269a1 with status ACTIVE [ 1154.962609] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.962609] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.962609] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.962609] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.962609] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.962609] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.962609] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.962982] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.962982] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.962982] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.963117] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.963181] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.963219] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.964703] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.964703] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.964703] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 60cace41-0844-4cd2-a449-ebc03dc269a1 is going to be updated. [ 1154.969513] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 in Status: SUCCESS [ 1154.969567] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.970164] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.970372] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.970548] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.970658] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.970723] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.970871] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.970951] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.971047] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.971136] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b60d7eaa-9583-4c75-97fa-4049c63576b6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.000650] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.000801] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.000841] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.001389] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.001389] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.001389] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-60cace41-0844-4cd2-a449-ebc03dc269a1" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.329145] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 19062702-bd29-4477-a732-5169f347b4da in Status: SUCCESS [ 1155.329145] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.440997] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.441171] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.441243] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.441491] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.465323] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.465683] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.465877] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.465877] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.466074] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.466074] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.466287] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bca01ddc-73d5-4856-bbff-aefad642492a is going to be updated. [ 1155.467349] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('25d71d6e-f381-40cd-b3d0-6c5c495c4c87',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.476079] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60d7eaa-9583-4c75-97fa-4049c63576b6 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.476079] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.476079] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.476079] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.476079] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.476079] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.476079] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.476079] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.476079] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.476079] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.476079] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60d7eaa-9583-4c75-97fa-4049c63576b6 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.476079] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.476079] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.476079] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.476079] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.476644] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.476644] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.476644] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.477770] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.477770] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.477770] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b60d7eaa-9583-4c75-97fa-4049c63576b6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.495558] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.495724] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.495798] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.496016] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.496286] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.505322] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bca01ddc-73d5-4856-bbff-aefad642492a in Status: IN_PROGRESS for 2s [ 1155.970209] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.970443] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.970492] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.970869] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.970869] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.973727] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25d71d6e-f381-40cd-b3d0-6c5c495c4c87 is going to be created. [ 1155.980994] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b60d7eaa-9583-4c75-97fa-4049c63576b6: rpc.has_security_group_logging(os_id): False [ 1155.998920] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.999147] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.999147] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.999366] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.999529] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.012783] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.012940] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.013020] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.013246] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.013378] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.013603] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.013717] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.013782] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.013946] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.014055] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.014358] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.014469] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.014797] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.014987] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.015073] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.015303] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.015504] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.015587] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.015837] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.015946] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.016065] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 is going to be updated. [ 1156.018348] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25d71d6e-f381-40cd-b3d0-6c5c495c4c87 in Status: UNINITIALIZED for 2s [ 1156.096203] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.096203] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.096203] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.096203] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.096203] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.111419] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 in Status: IN_PROGRESS for 2s [ 1157.516583] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bca01ddc-73d5-4856-bbff-aefad642492a in Status: SUCCESS [ 1157.516958] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bca01ddc-73d5-4856-bbff-aefad642492a deletion is rescheduled due to dependency. [ 1157.516958] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.665985] env[70392]: INFO networking_nsxv3.common.synchronization [req-8dc139b2-4a96-4e17-aaff-2cfac58ee3d1 req-da13b1a7-bd21-42b4-bbec-4ca3bf4aa9fe tempest-ImagesNegativeTestJSON-1224381487 tempest-ImagesNegativeTestJSON-1224381487-project-member] Enqueued Resource ID: 0ee28657-f5b1-4532-8f08-2a14f39970ca with Priority: HIGHEST for action security_group_members [ 1157.666608] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ee28657-f5b1-4532-8f08-2a14f39970ca with Priority: HIGHEST for action security_group_members [ 1157.666915] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ee28657-f5b1-4532-8f08-2a14f39970ca taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.667082] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ee28657-f5b1-4532-8f08-2a14f39970ca" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.667168] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ee28657-f5b1-4532-8f08-2a14f39970ca" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.667605] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ee28657-f5b1-4532-8f08-2a14f39970ca" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.667820] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.667957] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.668217] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.668217] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.668307] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.668400] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ee28657-f5b1-4532-8f08-2a14f39970ca',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.009048] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-196 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.009236] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-196" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.009277] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-196" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.010239] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-196" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.010239] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.010239] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.010661] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.010661] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.010752] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.011369] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1158.011369] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1158.011369] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1158.011369] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1158.011865] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1158.011865] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1158.011865] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1158.032533] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25d71d6e-f381-40cd-b3d0-6c5c495c4c87 in Status: SUCCESS [ 1158.032533] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25d71d6e-f381-40cd-b3d0-6c5c495c4c87" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.032533] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25d71d6e-f381-40cd-b3d0-6c5c495c4c87" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.032533] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25d71d6e-f381-40cd-b3d0-6c5c495c4c87" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.032533] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.032533] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.032533] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.032533] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.032533] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.032533] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25d71d6e-f381-40cd-b3d0-6c5c495c4c87" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.032533] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('25d71d6e-f381-40cd-b3d0-6c5c495c4c87',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.035513] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1158.035513] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1158.035513] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1158.035513] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-196" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.035513] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-e3ccc3c5-748e-42f2-afab-553f0e291106 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.035513] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-e3ccc3c5-748e-42f2-afab-553f0e291106" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.035513] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-e3ccc3c5-748e-42f2-afab-553f0e291106" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.035836] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-e3ccc3c5-748e-42f2-afab-553f0e291106" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.035919] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3ccc3c5-748e-42f2-afab-553f0e291106',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.130305] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 in Status: SUCCESS [ 1158.130305] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.171321] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.172510] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.172510] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.172510] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.172510] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.172510] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.172843] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.172843] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.172843] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.172963] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.173154] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ee28657-f5b1-4532-8f08-2a14f39970ca already deleted. [ 1158.173154] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ee28657-f5b1-4532-8f08-2a14f39970ca" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.538023] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('25d71d6e-f381-40cd-b3d0-6c5c495c4c87',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.539376] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.539611] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.539710] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.540168] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.540254] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.540443] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port e3ccc3c5-748e-42f2-afab-553f0e291106 not found, creating... [ 1158.540665] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.540913] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.540992] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.541216] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.541448] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.541843] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.542096] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.542332] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.542712] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.543132] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.543132] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: e3ccc3c5-748e-42f2-afab-553f0e291106 is going to be created. [ 1158.566353] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.566765] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.566838] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.567127] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.567497] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.567784] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-e3ccc3c5-748e-42f2-afab-553f0e291106" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.045523] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 25d71d6e-f381-40cd-b3d0-6c5c495c4c87: rpc.has_security_group_logging(os_id): False [ 1159.068388] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.068615] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.069714] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.069714] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.069714] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.069714] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.069714] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.070089] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.070089] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.070245] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.070342] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 25d71d6e-f381-40cd-b3d0-6c5c495c4c87 is going to be created. [ 1159.156173] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.156173] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.156173] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.156173] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.156173] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.168109] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 25d71d6e-f381-40cd-b3d0-6c5c495c4c87 in Status: IN_PROGRESS for 2s [ 1159.388781] env[70392]: INFO networking_nsxv3.common.synchronization [req-8dc139b2-4a96-4e17-aaff-2cfac58ee3d1 req-729c4acd-8731-44cb-b8f7-65960d7b4b16 service nova] Enqueued Resource ID: 0ee28657-f5b1-4532-8f08-2a14f39970ca with Priority: HIGHEST for action security_group_rules [ 1159.388781] env[70392]: INFO networking_nsxv3.common.synchronization [req-8dc139b2-4a96-4e17-aaff-2cfac58ee3d1 req-729c4acd-8731-44cb-b8f7-65960d7b4b16 service nova] Enqueued Resource ID: 0ee28657-f5b1-4532-8f08-2a14f39970ca with Priority: HIGHEST for action security_group_members [ 1159.388781] env[70392]: INFO networking_nsxv3.common.synchronization [req-8dc139b2-4a96-4e17-aaff-2cfac58ee3d1 req-729c4acd-8731-44cb-b8f7-65960d7b4b16 service nova] Enqueued Resource ID: e3ccc3c5-748e-42f2-afab-553f0e291106 with Priority: HIGHEST for action port [ 1159.388781] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ee28657-f5b1-4532-8f08-2a14f39970ca with Priority: HIGHEST for action security_group_rules [ 1159.388919] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ee28657-f5b1-4532-8f08-2a14f39970ca with Priority: HIGHEST for action security_group_members [ 1159.390757] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3ccc3c5-748e-42f2-afab-553f0e291106 with Priority: HIGHEST for action port [ 1159.390757] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ee28657-f5b1-4532-8f08-2a14f39970ca taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.390757] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ee28657-f5b1-4532-8f08-2a14f39970ca" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.390757] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ee28657-f5b1-4532-8f08-2a14f39970ca" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.390757] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ee28657-f5b1-4532-8f08-2a14f39970ca" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.390757] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ee28657-f5b1-4532-8f08-2a14f39970ca',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.391086] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ee28657-f5b1-4532-8f08-2a14f39970ca taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.391086] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ee28657-f5b1-4532-8f08-2a14f39970ca" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.391086] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ee28657-f5b1-4532-8f08-2a14f39970ca" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.391221] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ee28657-f5b1-4532-8f08-2a14f39970ca" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.391368] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.391455] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.391534] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.391648] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.391728] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.391813] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ee28657-f5b1-4532-8f08-2a14f39970ca',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.392545] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-e3ccc3c5-748e-42f2-afab-553f0e291106 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.392670] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e3ccc3c5-748e-42f2-afab-553f0e291106" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.392727] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e3ccc3c5-748e-42f2-afab-553f0e291106" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.392849] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e3ccc3c5-748e-42f2-afab-553f0e291106" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.392917] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3ccc3c5-748e-42f2-afab-553f0e291106',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.408874] env[70392]: INFO networking_nsxv3.common.synchronization [req-e3f5d9f5-bc36-4cda-a56b-6b8322bc2797 req-c844c006-6855-411b-b3b7-b0005e4c0684 tempest-ServersTestJSON-507292717 tempest-ServersTestJSON-507292717-project-member] Enqueued Resource ID: 19062702-bd29-4477-a732-5169f347b4da with Priority: HIGHEST for action security_group_members [ 1159.409853] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19062702-bd29-4477-a732-5169f347b4da with Priority: HIGHEST for action security_group_members [ 1159.410211] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-19062702-bd29-4477-a732-5169f347b4da taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.410341] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.410391] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.410586] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.410762] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.410862] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.410924] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.411097] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.411185] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.411293] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.896042] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ee28657-f5b1-4532-8f08-2a14f39970ca taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.896042] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ee28657-f5b1-4532-8f08-2a14f39970ca" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.896042] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0ee28657-f5b1-4532-8f08-2a14f39970ca',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.896722] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e3ccc3c5-748e-42f2-afab-553f0e291106 with status ACTIVE [ 1159.897222] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.897222] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.897222] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.897419] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.897488] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.897669] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.897771] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.897835] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.898034] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.898098] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.898283] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.898379] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.898440] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.898582] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.898655] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.898741] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e3ccc3c5-748e-42f2-afab-553f0e291106 is going to be updated. [ 1159.913561] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.922081] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.922250] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.922305] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.922500] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.922654] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.922822] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e3ccc3c5-748e-42f2-afab-553f0e291106" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.401027] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0ee28657-f5b1-4532-8f08-2a14f39970ca',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.416096] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.906580] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.906933] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.906933] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.907158] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.907276] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.907401] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ee28657-f5b1-4532-8f08-2a14f39970ca is going to be created. [ 1160.918510] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.918703] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.918785] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.919014] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.919144] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.919249] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19062702-bd29-4477-a732-5169f347b4da is going to be updated. [ 1160.933279] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.933494] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.933494] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.933680] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.933838] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.943128] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ee28657-f5b1-4532-8f08-2a14f39970ca in Status: UNINITIALIZED for 2s [ 1160.951464] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.951655] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.951753] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.951963] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.952116] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.962147] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19062702-bd29-4477-a732-5169f347b4da in Status: IN_PROGRESS for 2s [ 1161.181629] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 25d71d6e-f381-40cd-b3d0-6c5c495c4c87 in Status: SUCCESS [ 1161.181992] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-25d71d6e-f381-40cd-b3d0-6c5c495c4c87" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.593866] env[70392]: INFO networking_nsxv3.common.synchronization [req-e453f011-7954-4906-b667-87b245738023 req-0e2d2545-1c07-46c8-a9cd-e78584a023f2 tempest-AttachInterfacesTestJSON-2046649887 tempest-AttachInterfacesTestJSON-2046649887-project-member] Enqueued Resource ID: 73f697c6-7f54-4f76-8856-ccf1651be1c2 with Priority: HIGHEST for action security_group_members [ 1162.594396] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73f697c6-7f54-4f76-8856-ccf1651be1c2 with Priority: HIGHEST for action security_group_members [ 1162.594515] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-73f697c6-7f54-4f76-8856-ccf1651be1c2 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.594692] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73f697c6-7f54-4f76-8856-ccf1651be1c2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.594692] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73f697c6-7f54-4f76-8856-ccf1651be1c2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.594861] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73f697c6-7f54-4f76-8856-ccf1651be1c2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.595021] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.595122] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.595239] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.595312] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.595393] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.595488] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('73f697c6-7f54-4f76-8856-ccf1651be1c2',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.961465] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ee28657-f5b1-4532-8f08-2a14f39970ca in Status: SUCCESS [ 1162.961705] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ee28657-f5b1-4532-8f08-2a14f39970ca" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.961920] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ee28657-f5b1-4532-8f08-2a14f39970ca" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.962186] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ee28657-f5b1-4532-8f08-2a14f39970ca" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.962374] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.962487] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.962588] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.962719] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.962799] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.962884] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ee28657-f5b1-4532-8f08-2a14f39970ca" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.963047] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0ee28657-f5b1-4532-8f08-2a14f39970ca',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.977058] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19062702-bd29-4477-a732-5169f347b4da in Status: SUCCESS [ 1162.979018] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.006215] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-328 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.006451] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.006585] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.006850] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.007115] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.007269] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.007399] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.007617] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.007811] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.008092] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1163.008221] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1163.008452] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1163.008452] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1163.008553] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1163.008673] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1163.008813] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1163.029140] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1163.029337] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1163.029451] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1163.030080] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.030080] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-42cb55a0-c587-4d75-bf79-61f46ee8f488 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.030324] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-42cb55a0-c587-4d75-bf79-61f46ee8f488" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.030324] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-42cb55a0-c587-4d75-bf79-61f46ee8f488" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.031583] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-42cb55a0-c587-4d75-bf79-61f46ee8f488" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.031583] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42cb55a0-c587-4d75-bf79-61f46ee8f488',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.097383] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('73f697c6-7f54-4f76-8856-ccf1651be1c2',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.469332] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ee28657-f5b1-4532-8f08-2a14f39970ca taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.469571] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ee28657-f5b1-4532-8f08-2a14f39970ca" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.469667] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ee28657-f5b1-4532-8f08-2a14f39970ca" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.469938] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ee28657-f5b1-4532-8f08-2a14f39970ca" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.470198] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.470332] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.470408] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.470603] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.470718] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.470808] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ee28657-f5b1-4532-8f08-2a14f39970ca" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.471024] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ee28657-f5b1-4532-8f08-2a14f39970ca taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.471124] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ee28657-f5b1-4532-8f08-2a14f39970ca" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.471218] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ee28657-f5b1-4532-8f08-2a14f39970ca" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.471377] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ee28657-f5b1-4532-8f08-2a14f39970ca" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.471559] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.471691] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.471785] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.472121] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.472121] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.472267] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ee28657-f5b1-4532-8f08-2a14f39970ca" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.472267] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0ee28657-f5b1-4532-8f08-2a14f39970ca',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.536866] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.537157] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.537323] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.537631] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.537799] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.538016] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 42cb55a0-c587-4d75-bf79-61f46ee8f488 not found, creating... [ 1163.538336] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.538521] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.538695] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.538925] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.543115] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.543752] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.543982] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.544188] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.544506] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.544679] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.544875] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 42cb55a0-c587-4d75-bf79-61f46ee8f488 is going to be created. [ 1163.575026] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.575026] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.575026] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.575026] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.575026] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.575026] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-42cb55a0-c587-4d75-bf79-61f46ee8f488" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.600182] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('73f697c6-7f54-4f76-8856-ccf1651be1c2',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.977865] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0ee28657-f5b1-4532-8f08-2a14f39970ca: rpc.has_security_group_logging(os_id): False [ 1164.000068] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.000244] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.000310] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.000561] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.000672] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.000875] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.000974] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.001047] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.001210] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.001299] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.001871] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.001871] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.001871] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.001871] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.001871] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.002106] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.002159] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.002252] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.002369] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.002468] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.002562] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ee28657-f5b1-4532-8f08-2a14f39970ca is going to be created. [ 1164.078320] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.078320] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.078320] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.078471] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.080217] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.093323] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ee28657-f5b1-4532-8f08-2a14f39970ca in Status: IN_PROGRESS for 2s [ 1164.103034] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.103251] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.103309] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.103503] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.103653] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.103758] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73f697c6-7f54-4f76-8856-ccf1651be1c2 is going to be updated. [ 1164.150600] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.150943] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.150943] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.151109] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.151201] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.171571] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73f697c6-7f54-4f76-8856-ccf1651be1c2 in Status: IN_PROGRESS for 2s [ 1164.415610] env[70392]: INFO networking_nsxv3.common.synchronization [req-e453f011-7954-4906-b667-87b245738023 req-9d6fbdf0-3282-46e7-95fc-f940ff375548 service nova] Enqueued Resource ID: 73f697c6-7f54-4f76-8856-ccf1651be1c2 with Priority: HIGHEST for action security_group_rules [ 1164.415794] env[70392]: INFO networking_nsxv3.common.synchronization [req-e453f011-7954-4906-b667-87b245738023 req-9d6fbdf0-3282-46e7-95fc-f940ff375548 service nova] Enqueued Resource ID: 73f697c6-7f54-4f76-8856-ccf1651be1c2 with Priority: HIGHEST for action security_group_members [ 1164.415934] env[70392]: INFO networking_nsxv3.common.synchronization [req-e453f011-7954-4906-b667-87b245738023 req-9d6fbdf0-3282-46e7-95fc-f940ff375548 service nova] Enqueued Resource ID: 42cb55a0-c587-4d75-bf79-61f46ee8f488 with Priority: HIGHEST for action port [ 1164.416188] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73f697c6-7f54-4f76-8856-ccf1651be1c2 with Priority: HIGHEST for action security_group_rules [ 1164.416352] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73f697c6-7f54-4f76-8856-ccf1651be1c2 with Priority: HIGHEST for action security_group_members [ 1164.416739] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42cb55a0-c587-4d75-bf79-61f46ee8f488 with Priority: HIGHEST for action port [ 1164.417349] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-73f697c6-7f54-4f76-8856-ccf1651be1c2 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.418063] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-73f697c6-7f54-4f76-8856-ccf1651be1c2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.418063] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-73f697c6-7f54-4f76-8856-ccf1651be1c2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.418063] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-73f697c6-7f54-4f76-8856-ccf1651be1c2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.418063] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('73f697c6-7f54-4f76-8856-ccf1651be1c2',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.419827] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-73f697c6-7f54-4f76-8856-ccf1651be1c2 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.419827] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73f697c6-7f54-4f76-8856-ccf1651be1c2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.419827] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-42cb55a0-c587-4d75-bf79-61f46ee8f488 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.419827] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-42cb55a0-c587-4d75-bf79-61f46ee8f488" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.419827] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-42cb55a0-c587-4d75-bf79-61f46ee8f488" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.420227] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-42cb55a0-c587-4d75-bf79-61f46ee8f488" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.420227] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42cb55a0-c587-4d75-bf79-61f46ee8f488',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.919853] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-73f697c6-7f54-4f76-8856-ccf1651be1c2 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.920629] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73f697c6-7f54-4f76-8856-ccf1651be1c2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.922418] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 42cb55a0-c587-4d75-bf79-61f46ee8f488 with status ACTIVE [ 1164.922638] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.922760] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.922839] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.923073] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.923183] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.923360] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.923461] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.923521] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.923695] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.923783] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.923964] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.924069] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.924132] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.924330] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.924563] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.924563] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 42cb55a0-c587-4d75-bf79-61f46ee8f488 is going to be updated. [ 1164.942791] env[70392]: INFO networking_nsxv3.common.synchronization [req-89f93c9f-29aa-40db-8681-2c1e6c5ff446 req-565256ab-5c05-4e36-9a8a-0d51d572e977 tempest-ServerDiskConfigTestJSON-277542510 tempest-ServerDiskConfigTestJSON-277542510-project-member] Enqueued Resource ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 with Priority: HIGHEST for action security_group_members [ 1164.943421] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 with Priority: HIGHEST for action security_group_members [ 1164.944034] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60d7eaa-9583-4c75-97fa-4049c63576b6 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.944034] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.944034] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.944416] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.944606] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.944714] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.944777] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.944944] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.945044] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.945141] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b60d7eaa-9583-4c75-97fa-4049c63576b6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.950193] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.950193] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.950193] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.950193] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.950193] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.950193] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-42cb55a0-c587-4d75-bf79-61f46ee8f488" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.448800] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.449036] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.449087] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.449374] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.449519] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.449724] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.449903] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.450019] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.450295] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.450398] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.450545] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 is going to be updated. [ 1165.480749] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.480942] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.480942] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.481100] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.481296] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.490502] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 in Status: IN_PROGRESS for 2s [ 1166.109905] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ee28657-f5b1-4532-8f08-2a14f39970ca in Status: SUCCESS [ 1166.110309] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ee28657-f5b1-4532-8f08-2a14f39970ca" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.185815] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73f697c6-7f54-4f76-8856-ccf1651be1c2 in Status: SUCCESS [ 1166.188014] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73f697c6-7f54-4f76-8856-ccf1651be1c2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.188014] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73f697c6-7f54-4f76-8856-ccf1651be1c2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.188014] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73f697c6-7f54-4f76-8856-ccf1651be1c2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.188014] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.188014] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.188014] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.188014] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.188014] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.188014] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('73f697c6-7f54-4f76-8856-ccf1651be1c2',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.693531] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('73f697c6-7f54-4f76-8856-ccf1651be1c2',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.195887] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('73f697c6-7f54-4f76-8856-ccf1651be1c2',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.500045] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 in Status: SUCCESS [ 1167.500157] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 deletion is rescheduled due to dependency. [ 1167.500197] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.698593] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.698756] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.698810] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.699048] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.700018] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.700018] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73f697c6-7f54-4f76-8856-ccf1651be1c2 is going to be updated. [ 1167.736989] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.737211] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.737376] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.737584] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.737738] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.747392] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73f697c6-7f54-4f76-8856-ccf1651be1c2 in Status: IN_PROGRESS for 2s [ 1169.759050] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73f697c6-7f54-4f76-8856-ccf1651be1c2 in Status: SUCCESS [ 1169.759050] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73f697c6-7f54-4f76-8856-ccf1651be1c2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.759050] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73f697c6-7f54-4f76-8856-ccf1651be1c2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.759050] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73f697c6-7f54-4f76-8856-ccf1651be1c2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.759507] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.759507] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.759507] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.759507] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.759683] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.759683] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73f697c6-7f54-4f76-8856-ccf1651be1c2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.759745] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('73f697c6-7f54-4f76-8856-ccf1651be1c2',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.944181] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1169.944390] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1170.262451] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('73f697c6-7f54-4f76-8856-ccf1651be1c2',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.627893] env[70392]: INFO networking_nsxv3.common.synchronization [req-abbf5470-bfa4-45b4-aa6e-5753dd2f4a59 req-ae068669-6e34-47c7-8e6f-9a12e0eb0bc0 tempest-ImagesNegativeTestJSON-1224381487 tempest-ImagesNegativeTestJSON-1224381487-project-member] Enqueued Resource ID: 0ee28657-f5b1-4532-8f08-2a14f39970ca with Priority: HIGHEST for action security_group_members [ 1170.631811] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ee28657-f5b1-4532-8f08-2a14f39970ca with Priority: HIGHEST for action security_group_members [ 1170.632516] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ee28657-f5b1-4532-8f08-2a14f39970ca taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.632651] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ee28657-f5b1-4532-8f08-2a14f39970ca" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.632728] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ee28657-f5b1-4532-8f08-2a14f39970ca" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.632971] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ee28657-f5b1-4532-8f08-2a14f39970ca" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.633164] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.633282] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.633349] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.633513] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.633602] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.633700] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ee28657-f5b1-4532-8f08-2a14f39970ca',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.766864] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 73f697c6-7f54-4f76-8856-ccf1651be1c2: rpc.has_security_group_logging(os_id): False [ 1170.788546] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.788625] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.788660] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.788923] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.789036] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.789288] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.789392] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.789456] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.789617] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.789765] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.789800] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 73f697c6-7f54-4f76-8856-ccf1651be1c2 is going to be updated. [ 1170.871843] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.872073] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.872197] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.872448] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.872640] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.889772] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 73f697c6-7f54-4f76-8856-ccf1651be1c2 in Status: IN_PROGRESS for 2s [ 1171.137694] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.139011] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.139011] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.139011] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.139011] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.139011] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.139011] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.139216] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.139689] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.139689] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.139689] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ee28657-f5b1-4532-8f08-2a14f39970ca is going to be updated. [ 1171.185194] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.185194] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.185410] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.185519] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.185958] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.198981] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ee28657-f5b1-4532-8f08-2a14f39970ca in Status: IN_PROGRESS for 2s [ 1171.242528] env[70392]: INFO networking_nsxv3.common.synchronization [req-06d4378f-5a14-49bc-9c8c-2dd06d5e8859 req-230993bf-371b-4da6-aee3-460bef04a2e6 tempest-ServersTestMultiNic-1661297721 tempest-ServersTestMultiNic-1661297721-project-member] Enqueued Resource ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 with Priority: HIGHEST for action security_group_members [ 1171.244747] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 with Priority: HIGHEST for action security_group_members [ 1171.246021] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-81234d09-eeda-4e4f-bbe7-9aa250a3b427 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.246021] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.246021] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.246021] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.246253] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.246353] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.246490] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.247354] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.247595] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.247753] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('81234d09-eeda-4e4f-bbe7-9aa250a3b427',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.583771] env[70392]: INFO networking_nsxv3.common.synchronization [req-06d4378f-5a14-49bc-9c8c-2dd06d5e8859 req-ad74d5d9-0793-4371-b1e4-7427dfa5ec83 tempest-ServersTestMultiNic-1661297721 tempest-ServersTestMultiNic-1661297721-project-member] Enqueued Resource ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 with Priority: HIGHEST for action security_group_members [ 1171.584349] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 with Priority: HIGHEST for action security_group_members [ 1171.584675] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-81234d09-eeda-4e4f-bbe7-9aa250a3b427 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.584796] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.751027] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.751223] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.751223] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.751422] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.751516] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.751725] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.751826] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.751888] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.752051] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.752129] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.752217] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 already deleted. [ 1171.752298] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.752465] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.752617] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.752761] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.752857] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.752912] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.753074] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.753150] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.753242] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('81234d09-eeda-4e4f-bbe7-9aa250a3b427',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.920687] env[70392]: INFO networking_nsxv3.common.synchronization [req-06d4378f-5a14-49bc-9c8c-2dd06d5e8859 req-03ac11c9-1c95-4ebd-83e9-b76e58e27792 tempest-ServersTestMultiNic-1661297721 tempest-ServersTestMultiNic-1661297721-project-member] Enqueued Resource ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 with Priority: HIGHEST for action security_group_members [ 1171.921794] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 with Priority: HIGHEST for action security_group_members [ 1171.921794] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-81234d09-eeda-4e4f-bbe7-9aa250a3b427 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.921794] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.255752] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.256107] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.256218] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.256562] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.256704] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.256957] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.259805] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.259805] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.259805] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.259805] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.259805] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 already deleted. [ 1172.259805] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.259805] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.259805] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.259805] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.259805] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.259805] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.259805] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.259805] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.259805] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('81234d09-eeda-4e4f-bbe7-9aa250a3b427',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.314163] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-498 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.314395] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-498" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.314515] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-498" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.314927] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-498" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.315378] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.315587] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.315761] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.316114] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.316339] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.316684] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1172.316887] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1172.317093] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1172.317259] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1172.317532] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1172.317683] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1172.317877] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1172.339763] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1172.340770] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1172.340770] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1172.340770] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-498" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.341018] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-14053428-0deb-406a-a466-023539a10de4 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.341263] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-14053428-0deb-406a-a466-023539a10de4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.341364] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-14053428-0deb-406a-a466-023539a10de4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.341710] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-14053428-0deb-406a-a466-023539a10de4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.341871] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14053428-0deb-406a-a466-023539a10de4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.764588] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.764773] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.764848] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.765078] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.765168] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.765371] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.765469] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.765532] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.766111] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.766111] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.766111] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 already deleted. [ 1172.766111] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.844365] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.844605] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.844737] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.845039] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.845201] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.845365] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 14053428-0deb-406a-a466-023539a10de4 not found, creating... [ 1172.845656] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.845823] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.845943] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.846188] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.846327] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.846648] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.846807] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.846929] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.847157] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.847294] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.847437] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 14053428-0deb-406a-a466-023539a10de4 is going to be created. [ 1172.900879] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.900879] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.901188] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.901322] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.901577] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.901955] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-14053428-0deb-406a-a466-023539a10de4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.917033] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 73f697c6-7f54-4f76-8856-ccf1651be1c2 in Status: SUCCESS [ 1172.917033] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-73f697c6-7f54-4f76-8856-ccf1651be1c2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.208387] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ee28657-f5b1-4532-8f08-2a14f39970ca in Status: SUCCESS [ 1173.208685] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ee28657-f5b1-4532-8f08-2a14f39970ca deletion is rescheduled due to dependency. [ 1173.208685] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ee28657-f5b1-4532-8f08-2a14f39970ca" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.939750] env[70392]: INFO networking_nsxv3.common.synchronization [req-06d4378f-5a14-49bc-9c8c-2dd06d5e8859 req-987a9234-1caa-48e8-935e-ceee017e1751 service nova] Enqueued Resource ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 with Priority: HIGHEST for action security_group_rules [ 1173.939916] env[70392]: INFO networking_nsxv3.common.synchronization [req-06d4378f-5a14-49bc-9c8c-2dd06d5e8859 req-987a9234-1caa-48e8-935e-ceee017e1751 service nova] Enqueued Resource ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 with Priority: HIGHEST for action security_group_members [ 1173.940071] env[70392]: INFO networking_nsxv3.common.synchronization [req-06d4378f-5a14-49bc-9c8c-2dd06d5e8859 req-987a9234-1caa-48e8-935e-ceee017e1751 service nova] Enqueued Resource ID: 14053428-0deb-406a-a466-023539a10de4 with Priority: HIGHEST for action port [ 1173.940326] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 with Priority: HIGHEST for action security_group_rules [ 1173.940441] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 with Priority: HIGHEST for action security_group_members [ 1173.940540] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14053428-0deb-406a-a466-023539a10de4 with Priority: HIGHEST for action port [ 1173.945472] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-81234d09-eeda-4e4f-bbe7-9aa250a3b427 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.945626] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.945699] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.945970] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.946070] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('81234d09-eeda-4e4f-bbe7-9aa250a3b427',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.947062] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-81234d09-eeda-4e4f-bbe7-9aa250a3b427 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.947174] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.947244] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.947687] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.947687] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.947687] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.947687] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.947915] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.947915] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.948016] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('81234d09-eeda-4e4f-bbe7-9aa250a3b427',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.948778] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-14053428-0deb-406a-a466-023539a10de4 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.948918] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-14053428-0deb-406a-a466-023539a10de4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.948965] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-14053428-0deb-406a-a466-023539a10de4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.951842] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-14053428-0deb-406a-a466-023539a10de4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.951954] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14053428-0deb-406a-a466-023539a10de4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.454668] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-81234d09-eeda-4e4f-bbe7-9aa250a3b427 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.455020] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.455151] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('81234d09-eeda-4e4f-bbe7-9aa250a3b427',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.456049] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 14053428-0deb-406a-a466-023539a10de4 with status ACTIVE [ 1174.459828] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.459828] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.459828] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.459828] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.459828] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.459828] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.459828] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.459828] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.459828] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.459828] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.459828] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.459828] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.459828] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.459828] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.459828] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.459828] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 14053428-0deb-406a-a466-023539a10de4 is going to be updated. [ 1174.481251] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.482197] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.484076] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.484076] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.484076] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.484076] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-14053428-0deb-406a-a466-023539a10de4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.960822] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('81234d09-eeda-4e4f-bbe7-9aa250a3b427',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.056932] env[70392]: INFO networking_nsxv3.common.synchronization [None req-c712201d-08c8-4705-9462-e492cb6a3d88 tempest-AttachInterfacesTestJSON-2046649887 tempest-AttachInterfacesTestJSON-2046649887-project-member] Enqueued Resource ID: 3507e503-4abd-47ec-8347-82fc9e691881 with Priority: HIGHEST for action security_group_members [ 1175.058019] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3507e503-4abd-47ec-8347-82fc9e691881 with Priority: HIGHEST for action security_group_members [ 1175.058267] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-3507e503-4abd-47ec-8347-82fc9e691881 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.058397] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.058464] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.058670] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.058829] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.059201] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.059201] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.059201] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.059326] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.059356] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3507e503-4abd-47ec-8347-82fc9e691881',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.171520] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-52 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.171688] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-52" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.171854] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-52" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.172362] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-52" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.172613] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.172836] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.172987] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.173363] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.173480] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.173858] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1175.174129] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1175.174376] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1175.174620] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1175.174878] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1175.175094] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1175.175309] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1175.200829] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1175.200829] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1175.200829] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1175.200829] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-52" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.200829] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-43909b39-f5fc-4d91-bff4-4c7f59d1c0ff taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.200829] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-43909b39-f5fc-4d91-bff4-4c7f59d1c0ff" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.200829] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-43909b39-f5fc-4d91-bff4-4c7f59d1c0ff" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.200829] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-43909b39-f5fc-4d91-bff4-4c7f59d1c0ff" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.200829] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43909b39-f5fc-4d91-bff4-4c7f59d1c0ff',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.463810] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.464158] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.464158] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.464265] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.464354] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.464455] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 is going to be created. [ 1175.488272] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.488447] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.488489] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.488728] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.488889] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.498189] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 in Status: UNINITIALIZED for 2s [ 1175.561825] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.562059] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.562059] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.562300] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.587086] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.587321] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.587441] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.587511] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.587743] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.587831] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.587923] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3507e503-4abd-47ec-8347-82fc9e691881 is going to be updated. [ 1175.611933] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.612138] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.612138] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.612352] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.612489] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.621325] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3507e503-4abd-47ec-8347-82fc9e691881 in Status: IN_PROGRESS for 2s [ 1175.702756] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.702988] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.703139] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.703433] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.703586] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.704142] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 43909b39-f5fc-4d91-bff4-4c7f59d1c0ff not found, creating... [ 1175.704142] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.704271] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.704319] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.704678] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.704783] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.705090] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.705247] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.705366] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.705581] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.705714] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.705856] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 43909b39-f5fc-4d91-bff4-4c7f59d1c0ff is going to be created. [ 1175.733155] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.733531] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.733531] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.733790] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.734035] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.734305] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-43909b39-f5fc-4d91-bff4-4c7f59d1c0ff" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.420027] env[70392]: INFO networking_nsxv3.common.synchronization [req-06d4378f-5a14-49bc-9c8c-2dd06d5e8859 req-9c4b4a28-0a4d-4af1-947f-3592609fd2dd service nova] Enqueued Resource ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 with Priority: HIGHEST for action security_group_rules [ 1176.420027] env[70392]: INFO networking_nsxv3.common.synchronization [req-06d4378f-5a14-49bc-9c8c-2dd06d5e8859 req-9c4b4a28-0a4d-4af1-947f-3592609fd2dd service nova] Enqueued Resource ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 with Priority: HIGHEST for action security_group_members [ 1176.420027] env[70392]: INFO networking_nsxv3.common.synchronization [req-06d4378f-5a14-49bc-9c8c-2dd06d5e8859 req-9c4b4a28-0a4d-4af1-947f-3592609fd2dd service nova] Enqueued Resource ID: 43909b39-f5fc-4d91-bff4-4c7f59d1c0ff with Priority: HIGHEST for action port [ 1176.420027] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 with Priority: HIGHEST for action security_group_rules [ 1176.420027] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 with Priority: HIGHEST for action security_group_members [ 1176.420027] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43909b39-f5fc-4d91-bff4-4c7f59d1c0ff with Priority: HIGHEST for action port [ 1176.420027] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-81234d09-eeda-4e4f-bbe7-9aa250a3b427 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.420027] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.420027] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-81234d09-eeda-4e4f-bbe7-9aa250a3b427 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.420027] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.420027] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-43909b39-f5fc-4d91-bff4-4c7f59d1c0ff taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.420027] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-43909b39-f5fc-4d91-bff4-4c7f59d1c0ff" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.420027] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-43909b39-f5fc-4d91-bff4-4c7f59d1c0ff" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.420027] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-43909b39-f5fc-4d91-bff4-4c7f59d1c0ff" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.420027] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43909b39-f5fc-4d91-bff4-4c7f59d1c0ff',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.922645] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 43909b39-f5fc-4d91-bff4-4c7f59d1c0ff with status ACTIVE [ 1176.922967] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.923037] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.923168] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.923407] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.923576] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.923831] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.924049] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.924049] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.924255] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.924338] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.924535] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.924650] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.924708] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.924855] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.924930] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.925033] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 43909b39-f5fc-4d91-bff4-4c7f59d1c0ff is going to be updated. [ 1176.948064] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.948288] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.948338] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.948531] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.948664] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.948902] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-43909b39-f5fc-4d91-bff4-4c7f59d1c0ff" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.175640] env[70392]: INFO networking_nsxv3.common.synchronization [req-8b2ae3c1-9b91-4b9d-90eb-134b4045f407 req-ba435e43-730e-4288-ae98-ccfcc5d53159 tempest-ImagesTestJSON-499820929 tempest-ImagesTestJSON-499820929-project-member] Enqueued Resource ID: bca01ddc-73d5-4856-bbff-aefad642492a with Priority: HIGHEST for action security_group_members [ 1177.175640] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bca01ddc-73d5-4856-bbff-aefad642492a with Priority: HIGHEST for action security_group_members [ 1177.175640] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-bca01ddc-73d5-4856-bbff-aefad642492a taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.175970] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.176875] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.177232] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.177325] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.177475] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.177624] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.177840] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.177903] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.177960] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bca01ddc-73d5-4856-bbff-aefad642492a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.382542] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-498 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.382763] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-498" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.382931] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-498" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.383283] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-498" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.383584] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.383761] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.383902] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.384606] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.384804] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.385075] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1177.385211] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1177.385330] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1177.385621] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1177.385819] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1177.385976] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1177.386167] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1177.413682] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1177.414027] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1177.414208] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1177.414440] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-498" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.415111] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-38461d03-3fe6-4fa7-b0c1-84769c81d2a7 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.415230] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-38461d03-3fe6-4fa7-b0c1-84769c81d2a7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.415281] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-38461d03-3fe6-4fa7-b0c1-84769c81d2a7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.415650] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-38461d03-3fe6-4fa7-b0c1-84769c81d2a7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.415808] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38461d03-3fe6-4fa7-b0c1-84769c81d2a7',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.511192] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 in Status: SUCCESS [ 1177.511192] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.511192] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.511192] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.511192] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.511192] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.511192] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.511192] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.511192] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.511192] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.511192] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('81234d09-eeda-4e4f-bbe7-9aa250a3b427',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.511192] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.511192] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.511192] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.511192] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.511192] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.511192] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.511192] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.512211] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('81234d09-eeda-4e4f-bbe7-9aa250a3b427',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.606804] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-153 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.607033] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-153" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.607168] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-153" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.607432] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-153" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.607697] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.607870] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.607968] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.609145] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.609347] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.609571] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1177.609697] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1177.609820] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1177.609950] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1177.610061] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1177.610176] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1177.610311] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1177.629121] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1177.629308] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1177.629473] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1177.629697] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-153" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.630044] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-6c849f8f-ac86-498c-be3d-1796f5e4d86c taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.630231] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-6c849f8f-ac86-498c-be3d-1796f5e4d86c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.630353] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-6c849f8f-ac86-498c-be3d-1796f5e4d86c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.630666] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-6c849f8f-ac86-498c-be3d-1796f5e4d86c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.630815] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c849f8f-ac86-498c-be3d-1796f5e4d86c',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.635022] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3507e503-4abd-47ec-8347-82fc9e691881 in Status: SUCCESS [ 1177.635022] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3507e503-4abd-47ec-8347-82fc9e691881 deletion is rescheduled due to dependency. [ 1177.635022] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.682945] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.683126] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.683200] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.683416] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.683510] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.683705] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.683803] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.683866] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.684023] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.684103] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.684191] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bca01ddc-73d5-4856-bbff-aefad642492a is going to be updated. [ 1177.722474] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.724035] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.724035] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.724035] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.724035] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.732294] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bca01ddc-73d5-4856-bbff-aefad642492a in Status: IN_PROGRESS for 2s [ 1177.918183] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.918446] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.918584] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.918947] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.919130] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.919296] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 38461d03-3fe6-4fa7-b0c1-84769c81d2a7 not found, creating... [ 1177.919571] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.919744] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.919977] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.920346] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.920497] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.920785] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.920946] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.921082] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.921301] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.921438] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.921582] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 38461d03-3fe6-4fa7-b0c1-84769c81d2a7 is going to be created. [ 1177.941061] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.941450] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.941590] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.941868] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.942116] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.942352] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-38461d03-3fe6-4fa7-b0c1-84769c81d2a7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.015315] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('81234d09-eeda-4e4f-bbe7-9aa250a3b427',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.016449] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-81234d09-eeda-4e4f-bbe7-9aa250a3b427 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.016617] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.136055] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.136055] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.136055] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.136055] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.136055] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.136395] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 6c849f8f-ac86-498c-be3d-1796f5e4d86c not found, creating... [ 1178.136495] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.136708] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.136834] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.137097] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.137249] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.137542] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.137751] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.137883] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.138131] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.138266] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.138413] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 6c849f8f-ac86-498c-be3d-1796f5e4d86c is going to be created. [ 1178.157449] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.157638] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.157816] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.158101] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.158338] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.158924] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-6c849f8f-ac86-498c-be3d-1796f5e4d86c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.518235] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('81234d09-eeda-4e4f-bbe7-9aa250a3b427',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.905634] env[70392]: INFO networking_nsxv3.common.synchronization [req-06d4378f-5a14-49bc-9c8c-2dd06d5e8859 req-02470251-51aa-4905-a209-18ffb1082b22 service nova] Enqueued Resource ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 with Priority: HIGHEST for action security_group_rules [ 1178.905855] env[70392]: INFO networking_nsxv3.common.synchronization [req-06d4378f-5a14-49bc-9c8c-2dd06d5e8859 req-02470251-51aa-4905-a209-18ffb1082b22 service nova] Enqueued Resource ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 with Priority: HIGHEST for action security_group_members [ 1178.906048] env[70392]: INFO networking_nsxv3.common.synchronization [req-06d4378f-5a14-49bc-9c8c-2dd06d5e8859 req-02470251-51aa-4905-a209-18ffb1082b22 service nova] Enqueued Resource ID: 38461d03-3fe6-4fa7-b0c1-84769c81d2a7 with Priority: HIGHEST for action port [ 1178.906290] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 with Priority: HIGHEST for action security_group_rules [ 1178.906417] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 with Priority: HIGHEST for action security_group_members [ 1178.906534] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38461d03-3fe6-4fa7-b0c1-84769c81d2a7 with Priority: HIGHEST for action port [ 1178.908990] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-81234d09-eeda-4e4f-bbe7-9aa250a3b427 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.909141] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.909374] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-81234d09-eeda-4e4f-bbe7-9aa250a3b427 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.909469] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.909668] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-38461d03-3fe6-4fa7-b0c1-84769c81d2a7 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.909777] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-38461d03-3fe6-4fa7-b0c1-84769c81d2a7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.909845] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-38461d03-3fe6-4fa7-b0c1-84769c81d2a7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.910105] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-38461d03-3fe6-4fa7-b0c1-84769c81d2a7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.910197] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38461d03-3fe6-4fa7-b0c1-84769c81d2a7',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.928578] env[70392]: INFO networking_nsxv3.common.synchronization [req-8b2ae3c1-9b91-4b9d-90eb-134b4045f407 req-e98ef36c-27aa-41a2-bdd3-15566b7e1db4 service nova] Enqueued Resource ID: bca01ddc-73d5-4856-bbff-aefad642492a with Priority: HIGHEST for action security_group_rules [ 1178.928578] env[70392]: INFO networking_nsxv3.common.synchronization [req-8b2ae3c1-9b91-4b9d-90eb-134b4045f407 req-e98ef36c-27aa-41a2-bdd3-15566b7e1db4 service nova] Enqueued Resource ID: bca01ddc-73d5-4856-bbff-aefad642492a with Priority: HIGHEST for action security_group_members [ 1178.928578] env[70392]: INFO networking_nsxv3.common.synchronization [req-8b2ae3c1-9b91-4b9d-90eb-134b4045f407 req-e98ef36c-27aa-41a2-bdd3-15566b7e1db4 service nova] Enqueued Resource ID: 6c849f8f-ac86-498c-be3d-1796f5e4d86c with Priority: HIGHEST for action port [ 1178.929277] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bca01ddc-73d5-4856-bbff-aefad642492a with Priority: HIGHEST for action security_group_rules [ 1178.929517] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bca01ddc-73d5-4856-bbff-aefad642492a with Priority: HIGHEST for action security_group_members [ 1178.929738] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c849f8f-ac86-498c-be3d-1796f5e4d86c with Priority: HIGHEST for action port [ 1178.930248] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bca01ddc-73d5-4856-bbff-aefad642492a taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.930786] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.931108] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.931174] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.931291] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bca01ddc-73d5-4856-bbff-aefad642492a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.932458] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-bca01ddc-73d5-4856-bbff-aefad642492a taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.932606] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.932862] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-6c849f8f-ac86-498c-be3d-1796f5e4d86c taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.933006] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6c849f8f-ac86-498c-be3d-1796f5e4d86c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.933097] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6c849f8f-ac86-498c-be3d-1796f5e4d86c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.934108] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6c849f8f-ac86-498c-be3d-1796f5e4d86c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.934214] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c849f8f-ac86-498c-be3d-1796f5e4d86c',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.019982] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.020327] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.020327] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.020526] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.020617] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.020719] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 is going to be updated. [ 1179.052053] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.052301] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.052301] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.052603] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.052655] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.063109] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 in Status: IN_PROGRESS for 2s [ 1179.412480] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 38461d03-3fe6-4fa7-b0c1-84769c81d2a7 with status ACTIVE [ 1179.412864] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.413036] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.413127] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.413357] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.413449] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.413668] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.413777] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.413777] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.413931] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.414023] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.414204] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.414305] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.414362] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.414568] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.414568] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.414692] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 38461d03-3fe6-4fa7-b0c1-84769c81d2a7 is going to be updated. [ 1179.436871] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.437069] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.437069] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.437262] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.437400] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.437558] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-38461d03-3fe6-4fa7-b0c1-84769c81d2a7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.437899] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-bca01ddc-73d5-4856-bbff-aefad642492a taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.437984] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.438157] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6c849f8f-ac86-498c-be3d-1796f5e4d86c with status ACTIVE [ 1179.438336] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.438452] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.438504] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.438693] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.438790] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.439027] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.439146] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.439308] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.439370] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.439449] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.439664] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.439775] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.439856] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.440023] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.440099] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.440182] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6c849f8f-ac86-498c-be3d-1796f5e4d86c is going to be updated. [ 1179.461431] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.461592] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.461638] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.461842] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.461992] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.462157] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6c849f8f-ac86-498c-be3d-1796f5e4d86c" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.742770] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bca01ddc-73d5-4856-bbff-aefad642492a in Status: SUCCESS [ 1179.742947] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bca01ddc-73d5-4856-bbff-aefad642492a deletion is rescheduled due to dependency. [ 1179.743077] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.743239] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.743448] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.743631] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.743751] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.743816] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.743971] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.744070] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.744163] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bca01ddc-73d5-4856-bbff-aefad642492a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.246403] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bca01ddc-73d5-4856-bbff-aefad642492a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.749702] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bca01ddc-73d5-4856-bbff-aefad642492a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.074681] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 in Status: SUCCESS [ 1181.075138] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.075291] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.075736] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.076167] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.076390] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.076526] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.076901] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.077114] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.077334] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.077667] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-81234d09-eeda-4e4f-bbe7-9aa250a3b427 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.077868] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.078033] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.078384] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.078652] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.078901] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.079065] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.079348] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.079568] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.079776] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.079952] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('81234d09-eeda-4e4f-bbe7-9aa250a3b427',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.081290] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.081605] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.081834] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.082961] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.082961] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.082961] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.082961] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.082961] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('81234d09-eeda-4e4f-bbe7-9aa250a3b427',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.253121] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.253121] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.253121] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.253121] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.253481] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.253481] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bca01ddc-73d5-4856-bbff-aefad642492a is going to be updated. [ 1181.302161] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.302161] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.302161] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.303577] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.304637] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.315578] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bca01ddc-73d5-4856-bbff-aefad642492a in Status: IN_PROGRESS for 2s [ 1181.585245] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 81234d09-eeda-4e4f-bbe7-9aa250a3b427: rpc.has_security_group_logging(os_id): False [ 1181.586523] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('81234d09-eeda-4e4f-bbe7-9aa250a3b427',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.606077] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.606262] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.606262] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.606486] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.606578] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.606882] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.607024] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.607086] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.607263] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.607414] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.607552] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.607652] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.607785] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.608075] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.608179] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.608416] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.608592] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.608677] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.608850] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.608935] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.609037] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 is going to be created. [ 1181.672646] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.672916] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.672916] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.673067] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.673253] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.685142] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 in Status: IN_PROGRESS for 2s [ 1182.089226] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('81234d09-eeda-4e4f-bbe7-9aa250a3b427',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.592321] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.592616] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.592616] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.592765] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.592868] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.592993] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 is going to be updated. [ 1182.627289] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.627523] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.627643] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.627983] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.628189] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.638917] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 in Status: IN_PROGRESS for 2s [ 1182.916494] env[70392]: INFO networking_nsxv3.common.synchronization [req-c98d8643-4703-49bc-9ac1-e525cfb1d50d req-4110dbac-0d3f-42c0-ae45-70b34915e6cc tempest-ServerActionsTestOtherB-779604050 tempest-ServerActionsTestOtherB-779604050-project-member] Enqueued Resource ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 with Priority: HIGHEST for action security_group_members [ 1182.917049] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 with Priority: HIGHEST for action security_group_members [ 1182.917385] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.917477] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.917537] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.917806] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.917952] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.918081] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.918162] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.918336] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.918424] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.918522] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.328670] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bca01ddc-73d5-4856-bbff-aefad642492a in Status: SUCCESS [ 1183.328904] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.329124] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.329351] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.329548] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.329665] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.329731] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.329886] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.329972] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.330070] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.330163] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bca01ddc-73d5-4856-bbff-aefad642492a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.423066] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.423066] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.423066] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.423066] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.453222] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.453488] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.453675] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.453734] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.453927] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.454024] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.454120] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 is going to be updated. [ 1183.489381] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.489529] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.489596] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.489807] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.489954] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.499824] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 in Status: IN_PROGRESS for 2s [ 1183.701439] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 in Status: SUCCESS [ 1183.701713] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.701872] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.702375] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.702375] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('81234d09-eeda-4e4f-bbe7-9aa250a3b427',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.837042] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-bca01ddc-73d5-4856-bbff-aefad642492a taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.837042] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.837042] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.837042] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.837368] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.837368] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.837448] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.837597] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.837694] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.837782] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.837934] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-bca01ddc-73d5-4856-bbff-aefad642492a taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.838048] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.838265] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.838345] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.838444] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.838533] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.838594] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.838737] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.838817] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.838933] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.841271] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bca01ddc-73d5-4856-bbff-aefad642492a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.031606] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-328 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.031880] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.031952] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.032231] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.032681] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.032952] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.033060] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.033501] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.033882] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.034279] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1184.034561] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1184.034708] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1184.034832] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1184.034957] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1184.035106] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1184.035275] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1184.056332] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1184.056332] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1184.056332] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1184.056332] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.056538] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-2ec2fbec-6c4e-4a41-b0cb-99694c7a3b82 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.057122] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-2ec2fbec-6c4e-4a41-b0cb-99694c7a3b82" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.057122] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-2ec2fbec-6c4e-4a41-b0cb-99694c7a3b82" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.057566] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-2ec2fbec-6c4e-4a41-b0cb-99694c7a3b82" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.057566] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ec2fbec-6c4e-4a41-b0cb-99694c7a3b82',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.204834] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-81234d09-eeda-4e4f-bbe7-9aa250a3b427 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.204983] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.277933] env[70392]: INFO networking_nsxv3.common.synchronization [req-2af8820c-0771-41d2-96b5-944c26a90237 req-4ee69791-8d7e-44e3-bfcb-a9e1ce2b6655 tempest-DeleteServersTestJSON-1676313022 tempest-DeleteServersTestJSON-1676313022-project-member] Enqueued Resource ID: ce79170a-31ce-429e-8e08-a911557872f4 with Priority: HIGHEST for action security_group_members [ 1184.278490] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce79170a-31ce-429e-8e08-a911557872f4 with Priority: HIGHEST for action security_group_members [ 1184.279431] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce79170a-31ce-429e-8e08-a911557872f4 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.279431] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.279431] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.282324] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.282532] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.282664] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.282729] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.282966] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.283502] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.283502] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce79170a-31ce-429e-8e08-a911557872f4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.347873] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bca01ddc-73d5-4856-bbff-aefad642492a: rpc.has_security_group_logging(os_id): False [ 1184.368832] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.369636] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.369752] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.369959] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.370128] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.370318] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.370447] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.370629] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.370813] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.370895] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.371102] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.371713] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.371713] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.371713] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.371713] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.371713] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.371713] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.371972] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.371972] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.371972] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.372075] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bca01ddc-73d5-4856-bbff-aefad642492a is going to be updated. [ 1184.439592] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.442021] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.442021] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.442021] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.442021] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.458548] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bca01ddc-73d5-4856-bbff-aefad642492a in Status: IN_PROGRESS for 2s [ 1184.562732] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.562732] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.562732] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.562732] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.562732] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.562732] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 2ec2fbec-6c4e-4a41-b0cb-99694c7a3b82 not found, creating... [ 1184.562732] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.562732] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.562732] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.562732] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.562732] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.563340] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.563340] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.564902] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.566596] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.567139] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.567607] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 2ec2fbec-6c4e-4a41-b0cb-99694c7a3b82 is going to be created. [ 1184.594535] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.594535] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.594535] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.594535] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.594535] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.594535] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-2ec2fbec-6c4e-4a41-b0cb-99694c7a3b82" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.633698] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-422 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.633698] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-422" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.633698] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-422" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.633698] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-422" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.633698] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.633698] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.633698] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.633698] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.634207] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.634410] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1184.634592] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1184.634736] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1184.634891] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1184.635057] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1184.635212] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1184.635392] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1184.657751] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 in Status: SUCCESS [ 1184.658125] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.658551] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.658863] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.659113] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.659282] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.659372] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.659580] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.659700] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.659848] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.659951] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('81234d09-eeda-4e4f-bbe7-9aa250a3b427',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.669899] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1184.670577] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1184.670780] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1184.670977] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-422" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.671356] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-624362ae-b7f3-464f-a815-4939826760f5 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.671558] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-624362ae-b7f3-464f-a815-4939826760f5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.671663] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-624362ae-b7f3-464f-a815-4939826760f5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.672028] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-624362ae-b7f3-464f-a815-4939826760f5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.672585] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('624362ae-b7f3-464f-a815-4939826760f5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.790086] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.790493] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.790493] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.790665] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.790783] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.791041] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.791156] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.791245] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.791464] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.791557] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.791657] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce79170a-31ce-429e-8e08-a911557872f4 is going to be updated. [ 1184.823836] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.823836] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.823836] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.823836] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.824125] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.834758] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce79170a-31ce-429e-8e08-a911557872f4 in Status: IN_PROGRESS for 2s [ 1185.163022] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-81234d09-eeda-4e4f-bbe7-9aa250a3b427 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.163214] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.163292] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.163516] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.163697] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.163808] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.163882] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.164018] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.164348] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.164348] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.164455] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-81234d09-eeda-4e4f-bbe7-9aa250a3b427 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.164498] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.164579] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.164753] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.164924] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.165046] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.165094] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.165205] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.165283] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.165364] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.165454] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('81234d09-eeda-4e4f-bbe7-9aa250a3b427',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.175488] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.175723] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.175870] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.176188] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.176356] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.176528] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 624362ae-b7f3-464f-a815-4939826760f5 not found, creating... [ 1185.176886] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.177096] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.177240] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.177505] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.177659] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.178072] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.178181] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.178306] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.178539] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.178695] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.178853] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 624362ae-b7f3-464f-a815-4939826760f5 is going to be created. [ 1185.202928] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.203237] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.203347] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.203618] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.203928] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.204225] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-624362ae-b7f3-464f-a815-4939826760f5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.467374] env[70392]: INFO networking_nsxv3.common.synchronization [req-b0b603f0-b50f-42ff-8687-070b40a761b2 req-6761ec30-7776-47ba-8c46-7d863f320205 service nova] Enqueued Resource ID: 3507e503-4abd-47ec-8347-82fc9e691881 with Priority: HIGHEST for action security_group_rules [ 1185.467614] env[70392]: INFO networking_nsxv3.common.synchronization [req-b0b603f0-b50f-42ff-8687-070b40a761b2 req-6761ec30-7776-47ba-8c46-7d863f320205 service nova] Enqueued Resource ID: 3507e503-4abd-47ec-8347-82fc9e691881 with Priority: HIGHEST for action security_group_members [ 1185.467837] env[70392]: INFO networking_nsxv3.common.synchronization [req-b0b603f0-b50f-42ff-8687-070b40a761b2 req-6761ec30-7776-47ba-8c46-7d863f320205 service nova] Enqueued Resource ID: 2ec2fbec-6c4e-4a41-b0cb-99694c7a3b82 with Priority: HIGHEST for action port [ 1185.468499] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3507e503-4abd-47ec-8347-82fc9e691881 with Priority: HIGHEST for action security_group_rules [ 1185.468689] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3507e503-4abd-47ec-8347-82fc9e691881 with Priority: HIGHEST for action security_group_members [ 1185.468867] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ec2fbec-6c4e-4a41-b0cb-99694c7a3b82 with Priority: HIGHEST for action port [ 1185.471871] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3507e503-4abd-47ec-8347-82fc9e691881 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.472017] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.472084] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.472325] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.472411] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3507e503-4abd-47ec-8347-82fc9e691881',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.476679] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-3507e503-4abd-47ec-8347-82fc9e691881 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.476832] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.476925] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.477156] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.477341] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.477470] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.477609] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.477694] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.477767] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.477885] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3507e503-4abd-47ec-8347-82fc9e691881',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.479045] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-2ec2fbec-6c4e-4a41-b0cb-99694c7a3b82 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.479187] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2ec2fbec-6c4e-4a41-b0cb-99694c7a3b82" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.479241] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2ec2fbec-6c4e-4a41-b0cb-99694c7a3b82" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.479380] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2ec2fbec-6c4e-4a41-b0cb-99694c7a3b82" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.479458] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ec2fbec-6c4e-4a41-b0cb-99694c7a3b82',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.510630] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 in Status: SUCCESS [ 1185.510828] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 deletion is rescheduled due to dependency. [ 1185.510947] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.669096] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 81234d09-eeda-4e4f-bbe7-9aa250a3b427: rpc.has_security_group_logging(os_id): False [ 1185.687979] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.688138] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.688208] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.688414] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.688497] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.688677] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.688770] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.688831] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.688975] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.689060] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.689248] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.689337] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.689396] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.689528] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.689599] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.691105] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.691105] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.691105] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.691105] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.691105] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.691105] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 is going to be updated. [ 1185.781783] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.781783] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.781783] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.781783] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.781783] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.796480] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 in Status: IN_PROGRESS for 2s [ 1185.911333] env[70392]: INFO networking_nsxv3.common.synchronization [req-2af8820c-0771-41d2-96b5-944c26a90237 req-ae772e76-85d9-42b5-81d2-a02c53c7f346 service nova] Enqueued Resource ID: ce79170a-31ce-429e-8e08-a911557872f4 with Priority: HIGHEST for action security_group_rules [ 1185.911333] env[70392]: INFO networking_nsxv3.common.synchronization [req-2af8820c-0771-41d2-96b5-944c26a90237 req-ae772e76-85d9-42b5-81d2-a02c53c7f346 service nova] Enqueued Resource ID: ce79170a-31ce-429e-8e08-a911557872f4 with Priority: HIGHEST for action security_group_members [ 1185.911333] env[70392]: INFO networking_nsxv3.common.synchronization [req-2af8820c-0771-41d2-96b5-944c26a90237 req-ae772e76-85d9-42b5-81d2-a02c53c7f346 service nova] Enqueued Resource ID: 624362ae-b7f3-464f-a815-4939826760f5 with Priority: HIGHEST for action port [ 1185.911333] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce79170a-31ce-429e-8e08-a911557872f4 with Priority: HIGHEST for action security_group_rules [ 1185.911333] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce79170a-31ce-429e-8e08-a911557872f4 with Priority: HIGHEST for action security_group_members [ 1185.911333] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 624362ae-b7f3-464f-a815-4939826760f5 with Priority: HIGHEST for action port [ 1185.911810] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ce79170a-31ce-429e-8e08-a911557872f4 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.912168] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.912335] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.914090] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.914090] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ce79170a-31ce-429e-8e08-a911557872f4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.914090] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce79170a-31ce-429e-8e08-a911557872f4 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.914090] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.914362] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-624362ae-b7f3-464f-a815-4939826760f5 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.914429] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-624362ae-b7f3-464f-a815-4939826760f5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.914481] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-624362ae-b7f3-464f-a815-4939826760f5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.915873] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-624362ae-b7f3-464f-a815-4939826760f5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.915873] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('624362ae-b7f3-464f-a815-4939826760f5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.980685] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3507e503-4abd-47ec-8347-82fc9e691881',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.982183] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-3507e503-4abd-47ec-8347-82fc9e691881 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.982183] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.982683] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2ec2fbec-6c4e-4a41-b0cb-99694c7a3b82 with status ACTIVE [ 1185.982833] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.982944] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.983025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.983228] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.983322] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.983554] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.983603] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.983664] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.983915] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.984030] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.984225] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.984322] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.984384] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.984532] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.984609] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.984726] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2ec2fbec-6c4e-4a41-b0cb-99694c7a3b82 is going to be updated. [ 1186.008479] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.008663] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.008756] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.009039] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.009221] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.009390] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2ec2fbec-6c4e-4a41-b0cb-99694c7a3b82" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.416609] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce79170a-31ce-429e-8e08-a911557872f4 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.416951] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.416951] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 624362ae-b7f3-464f-a815-4939826760f5 with status ACTIVE [ 1186.417293] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.417293] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.417293] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.417518] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.417629] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.417821] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.417931] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.418076] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.418172] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.418241] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.418426] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.418530] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.418624] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.418701] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.418777] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.418877] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 624362ae-b7f3-464f-a815-4939826760f5 is going to be updated. [ 1186.440643] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.440835] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.440835] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.441074] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.441216] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.441372] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-624362ae-b7f3-464f-a815-4939826760f5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.483752] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bca01ddc-73d5-4856-bbff-aefad642492a in Status: SUCCESS [ 1186.483998] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.484301] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3507e503-4abd-47ec-8347-82fc9e691881',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.845908] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce79170a-31ce-429e-8e08-a911557872f4 in Status: SUCCESS [ 1186.846289] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce79170a-31ce-429e-8e08-a911557872f4 deletion is rescheduled due to dependency. [ 1186.846289] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.846384] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.846593] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.846827] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.846994] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.847173] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.847389] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.847486] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.847588] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce79170a-31ce-429e-8e08-a911557872f4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.986713] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.986968] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.987030] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.987256] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.987346] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.987447] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3507e503-4abd-47ec-8347-82fc9e691881 is going to be updated. [ 1187.018162] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.018357] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.018406] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.018610] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.018778] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.027783] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3507e503-4abd-47ec-8347-82fc9e691881 in Status: IN_PROGRESS for 2s [ 1187.350010] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ce79170a-31ce-429e-8e08-a911557872f4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.811125] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 in Status: SUCCESS [ 1187.811429] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.811552] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.811791] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.811902] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('81234d09-eeda-4e4f-bbe7-9aa250a3b427',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.852997] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ce79170a-31ce-429e-8e08-a911557872f4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.313889] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-81234d09-eeda-4e4f-bbe7-9aa250a3b427 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.314106] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.314185] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.314451] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.314667] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.315668] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.315752] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.315955] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.316069] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.316174] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.316262] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('81234d09-eeda-4e4f-bbe7-9aa250a3b427',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.355769] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.355951] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.356009] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.356303] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.356303] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.356414] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce79170a-31ce-429e-8e08-a911557872f4 is going to be updated. [ 1188.386044] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.386255] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.386348] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.386580] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.386736] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.396722] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce79170a-31ce-429e-8e08-a911557872f4 in Status: IN_PROGRESS for 2s [ 1188.818624] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-81234d09-eeda-4e4f-bbe7-9aa250a3b427 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.818765] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.818765] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.818950] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.819138] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.819236] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.819319] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.819450] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.820802] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.820916] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.821577] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-81234d09-eeda-4e4f-bbe7-9aa250a3b427 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.821577] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.821577] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.821577] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.821770] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.821770] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.821770] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.821915] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.821991] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.822084] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.822177] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('81234d09-eeda-4e4f-bbe7-9aa250a3b427',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.038838] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3507e503-4abd-47ec-8347-82fc9e691881 in Status: SUCCESS [ 1189.040224] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.040449] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.041120] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.041323] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.041444] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.041510] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.041667] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.041749] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.041834] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.041925] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3507e503-4abd-47ec-8347-82fc9e691881',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.327420] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 81234d09-eeda-4e4f-bbe7-9aa250a3b427: rpc.has_security_group_logging(os_id): False [ 1189.352057] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.352057] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.352057] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.352057] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.352355] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.352568] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.352656] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.352732] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.352985] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.356769] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.357190] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.358321] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.358982] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.359354] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.359538] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.359910] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.360168] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.360915] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.361139] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.361344] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.361554] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 is going to be updated. [ 1189.434525] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.434687] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.434786] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.435063] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.435231] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.453013] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 in Status: IN_PROGRESS for 2s [ 1189.546424] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-3507e503-4abd-47ec-8347-82fc9e691881 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.546689] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.546689] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.546958] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.547449] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.547449] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.547449] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.547650] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.547650] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.547725] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.547821] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-3507e503-4abd-47ec-8347-82fc9e691881 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.547918] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.548046] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.548118] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.548255] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.548347] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.548407] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.548543] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.548618] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.548699] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.548801] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3507e503-4abd-47ec-8347-82fc9e691881',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.056603] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3507e503-4abd-47ec-8347-82fc9e691881: rpc.has_security_group_logging(os_id): False [ 1190.073838] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.076082] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.076082] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.076082] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.076082] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.076082] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.076082] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.076082] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.076082] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.076082] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.076082] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.076082] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.076082] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.076082] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.076082] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.077811] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.080838] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.080838] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.080838] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.080838] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.080838] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3507e503-4abd-47ec-8347-82fc9e691881 is going to be updated. [ 1190.141598] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.141598] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.141598] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.141910] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.141945] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.160303] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3507e503-4abd-47ec-8347-82fc9e691881 in Status: IN_PROGRESS for 2s [ 1190.409186] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce79170a-31ce-429e-8e08-a911557872f4 in Status: SUCCESS [ 1190.409944] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.410059] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.410221] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.410471] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.410601] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.410648] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.410860] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.410906] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.410983] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.411268] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ce79170a-31ce-429e-8e08-a911557872f4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.912988] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1190.912988] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 1190.913467] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce79170a-31ce-429e-8e08-a911557872f4 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.913546] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.913580] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.913770] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.914259] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.914259] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.914259] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.914259] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.914541] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.914541] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.914541] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce79170a-31ce-429e-8e08-a911557872f4 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.914710] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.914710] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.915023] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.915113] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.915182] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.915230] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.918384] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.918384] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.918384] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.918384] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ce79170a-31ce-429e-8e08-a911557872f4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.417794] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ce79170a-31ce-429e-8e08-a911557872f4: rpc.has_security_group_logging(os_id): False [ 1191.438910] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.439091] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.439180] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.439409] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.439497] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.439726] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.439819] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.439893] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.440055] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.440129] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.440301] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.440414] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.440476] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.440622] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.440732] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.440981] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.441088] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.441148] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.441289] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.441360] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.441437] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ce79170a-31ce-429e-8e08-a911557872f4 is going to be updated. [ 1191.477309] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 in Status: SUCCESS [ 1191.477309] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.521276] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.521473] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.521473] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.521943] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.522168] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.538148] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ce79170a-31ce-429e-8e08-a911557872f4 in Status: IN_PROGRESS for 2s [ 1192.177653] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3507e503-4abd-47ec-8347-82fc9e691881 in Status: SUCCESS [ 1192.177653] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.724439] env[70392]: INFO networking_nsxv3.common.synchronization [None req-cac7e100-638c-4a46-b60c-75d4d7dd997f None None] Enqueued Resource ID: 3f013a55-27ca-425d-83a6-7d764891b0a2 with Priority: HIGHEST for action port [ 1192.725070] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f013a55-27ca-425d-83a6-7d764891b0a2 with Priority: HIGHEST for action port [ 1192.725417] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-3f013a55-27ca-425d-83a6-7d764891b0a2 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.725568] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3f013a55-27ca-425d-83a6-7d764891b0a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.725654] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3f013a55-27ca-425d-83a6-7d764891b0a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.725930] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3f013a55-27ca-425d-83a6-7d764891b0a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.726245] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3f013a55-27ca-425d-83a6-7d764891b0a2',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.213849] env[70392]: INFO networking_nsxv3.common.synchronization [None req-e0ac0b3f-39ca-48bf-a824-101508c5b421 tempest-ServerActionsTestJSON-648729814 tempest-ServerActionsTestJSON-648729814-project-member] Enqueued Resource ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 with Priority: HIGHEST for action security_group_rules [ 1193.214434] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 with Priority: HIGHEST for action security_group_rules [ 1193.214735] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.214876] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.214934] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.215204] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.215289] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e473c6e0-5940-4d57-ba2e-d012e6d8eeb9',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.232350] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3f013a55-27ca-425d-83a6-7d764891b0a2 [ 1193.232622] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.232765] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.232838] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.233066] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.233162] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.233259] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3f013a55-27ca-425d-83a6-7d764891b0a2 already deleted. [ 1193.233343] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3f013a55-27ca-425d-83a6-7d764891b0a2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.359478] env[70392]: INFO networking_nsxv3.common.synchronization [None req-d7ec2e60-77ad-4fa1-b65a-50528da4b12f tempest-ServerActionsTestJSON-648729814 tempest-ServerActionsTestJSON-648729814-project-member] Enqueued Resource ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 with Priority: HIGHEST for action security_group_rules [ 1193.360286] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 with Priority: HIGHEST for action security_group_rules [ 1193.360737] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.360885] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.455884] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-109 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.456413] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-109" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.456740] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-109" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.457111] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-109" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.457387] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.457546] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.457691] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.458330] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.458595] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.458850] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1193.459008] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1193.459166] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1193.459306] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1193.459447] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1193.459583] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1193.460127] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1193.493028] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1193.493028] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1193.493028] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1193.493028] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-109" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.493028] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-4a451501-d220-44ab-ae11-9eead0f8d216 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.493028] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-4a451501-d220-44ab-ae11-9eead0f8d216" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.493028] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-4a451501-d220-44ab-ae11-9eead0f8d216" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.493028] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-4a451501-d220-44ab-ae11-9eead0f8d216" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.493028] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a451501-d220-44ab-ae11-9eead0f8d216',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.555099] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ce79170a-31ce-429e-8e08-a911557872f4 in Status: SUCCESS [ 1193.555377] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.722267] env[70392]: INFO networking_nsxv3.common.synchronization [req-4dcef9a0-b492-4c0f-b698-1e7d3052e2ef req-c8e10435-7f01-42be-bca9-d23100fbc912 tempest-ServersTestMultiNic-1661297721 tempest-ServersTestMultiNic-1661297721-project-member] Enqueued Resource ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 with Priority: HIGHEST for action security_group_members [ 1193.722589] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 with Priority: HIGHEST for action security_group_members [ 1193.723667] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-81234d09-eeda-4e4f-bbe7-9aa250a3b427 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.723812] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.724213] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.724213] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.724694] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.724694] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.724694] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.724954] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.725101] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.725206] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('81234d09-eeda-4e4f-bbe7-9aa250a3b427',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.744404] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.744404] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.744404] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.744404] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.744563] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.744563] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 already deleted. [ 1193.744617] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.745212] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.745305] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.745512] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e473c6e0-5940-4d57-ba2e-d012e6d8eeb9',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.995823] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.996223] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.996223] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.996480] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.996636] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.996940] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.997132] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.997272] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.997532] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.997680] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.998031] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.998187] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.998279] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.998574] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.998609] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.998750] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 4a451501-d220-44ab-ae11-9eead0f8d216 is going to be updated. [ 1194.021413] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.021624] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.021751] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.022039] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.022242] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.022465] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-4a451501-d220-44ab-ae11-9eead0f8d216" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.079746] env[70392]: INFO networking_nsxv3.common.synchronization [req-4dcef9a0-b492-4c0f-b698-1e7d3052e2ef req-4d924aba-264b-4e05-89b7-fcaeb1203f9d tempest-ServersTestMultiNic-1661297721 tempest-ServersTestMultiNic-1661297721-project-member] Enqueued Resource ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 with Priority: HIGHEST for action security_group_members [ 1194.080741] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 with Priority: HIGHEST for action security_group_members [ 1194.080741] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-81234d09-eeda-4e4f-bbe7-9aa250a3b427 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.080880] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.232238] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('81234d09-eeda-4e4f-bbe7-9aa250a3b427',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.269375] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.269909] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.269909] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.269909] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.270055] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.270055] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 already deleted. [ 1194.270149] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.418706] env[70392]: INFO networking_nsxv3.common.synchronization [req-4dcef9a0-b492-4c0f-b698-1e7d3052e2ef req-2f52a843-b526-415c-825b-8fc6c069d93b tempest-ServersTestMultiNic-1661297721 tempest-ServersTestMultiNic-1661297721-project-member] Enqueued Resource ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 with Priority: HIGHEST for action security_group_members [ 1194.419261] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 with Priority: HIGHEST for action security_group_members [ 1194.419559] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-81234d09-eeda-4e4f-bbe7-9aa250a3b427 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.419672] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.735914] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('81234d09-eeda-4e4f-bbe7-9aa250a3b427',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.825819] env[70392]: INFO networking_nsxv3.common.synchronization [req-49d2584c-f0f9-4c33-a6d3-be8522f57173 req-6d1a7eeb-09f5-448d-899d-97395a1202c0 service nova] Enqueued Resource ID: ee8b641c-b2f7-4b94-85bb-98a31dba1604 with Priority: HIGHEST for action security_group_rules [ 1194.826016] env[70392]: INFO networking_nsxv3.common.synchronization [req-49d2584c-f0f9-4c33-a6d3-be8522f57173 req-6d1a7eeb-09f5-448d-899d-97395a1202c0 service nova] Enqueued Resource ID: ee8b641c-b2f7-4b94-85bb-98a31dba1604 with Priority: HIGHEST for action security_group_members [ 1194.826169] env[70392]: INFO networking_nsxv3.common.synchronization [req-49d2584c-f0f9-4c33-a6d3-be8522f57173 req-6d1a7eeb-09f5-448d-899d-97395a1202c0 service nova] Enqueued Resource ID: 4a451501-d220-44ab-ae11-9eead0f8d216 with Priority: HIGHEST for action port [ 1194.826400] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee8b641c-b2f7-4b94-85bb-98a31dba1604 with Priority: HIGHEST for action security_group_rules [ 1194.826528] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee8b641c-b2f7-4b94-85bb-98a31dba1604 with Priority: HIGHEST for action security_group_members [ 1194.826625] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a451501-d220-44ab-ae11-9eead0f8d216 with Priority: HIGHEST for action port [ 1194.827353] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee8b641c-b2f7-4b94-85bb-98a31dba1604 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.827477] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee8b641c-b2f7-4b94-85bb-98a31dba1604" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.827477] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee8b641c-b2f7-4b94-85bb-98a31dba1604" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.827659] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee8b641c-b2f7-4b94-85bb-98a31dba1604" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.827716] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee8b641c-b2f7-4b94-85bb-98a31dba1604',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.831927] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee8b641c-b2f7-4b94-85bb-98a31dba1604 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.831927] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee8b641c-b2f7-4b94-85bb-98a31dba1604" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.831927] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee8b641c-b2f7-4b94-85bb-98a31dba1604" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.831927] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee8b641c-b2f7-4b94-85bb-98a31dba1604" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.831927] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.831927] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.831927] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.831927] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.831927] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.831927] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee8b641c-b2f7-4b94-85bb-98a31dba1604',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.831927] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a451501-d220-44ab-ae11-9eead0f8d216 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.831927] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a451501-d220-44ab-ae11-9eead0f8d216" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.831927] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a451501-d220-44ab-ae11-9eead0f8d216" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.831927] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a451501-d220-44ab-ae11-9eead0f8d216" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.831927] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a451501-d220-44ab-ae11-9eead0f8d216',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.241953] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.242125] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.242252] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.242476] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.242739] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.242739] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 is going to be updated. [ 1195.278659] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.278864] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.278937] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.279945] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.280078] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.291714] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 in Status: IN_PROGRESS for 2s [ 1195.333733] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee8b641c-b2f7-4b94-85bb-98a31dba1604 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.333896] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee8b641c-b2f7-4b94-85bb-98a31dba1604" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.334118] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ee8b641c-b2f7-4b94-85bb-98a31dba1604',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.336540] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4a451501-d220-44ab-ae11-9eead0f8d216 with status ACTIVE [ 1195.336838] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.337017] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.337082] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.337293] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.337390] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.337572] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.337652] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.337692] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.337826] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.337976] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.339686] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.339829] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.340088] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.340186] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.340245] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.340349] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4a451501-d220-44ab-ae11-9eead0f8d216 is going to be updated. [ 1195.372362] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.372765] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.372765] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.373122] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.373231] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.373369] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a451501-d220-44ab-ae11-9eead0f8d216" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.392459] env[70392]: INFO networking_nsxv3.common.synchronization [None req-fa8b551c-77e8-47d5-84d8-bbe2e43072ab None None] Enqueued Resource ID: c24c4710-11f8-41d2-b31b-97bec5117db5 with Priority: HIGHEST for action port [ 1195.393116] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c24c4710-11f8-41d2-b31b-97bec5117db5 with Priority: HIGHEST for action port [ 1195.394685] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-c24c4710-11f8-41d2-b31b-97bec5117db5 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.394685] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c24c4710-11f8-41d2-b31b-97bec5117db5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.394685] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c24c4710-11f8-41d2-b31b-97bec5117db5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.394685] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c24c4710-11f8-41d2-b31b-97bec5117db5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.394685] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c24c4710-11f8-41d2-b31b-97bec5117db5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.836899] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ee8b641c-b2f7-4b94-85bb-98a31dba1604',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.897101] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c24c4710-11f8-41d2-b31b-97bec5117db5 [ 1195.897357] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.897492] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.897561] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.897782] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.897876] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.897981] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c24c4710-11f8-41d2-b31b-97bec5117db5 already deleted. [ 1195.898138] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c24c4710-11f8-41d2-b31b-97bec5117db5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.341023] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.341275] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.341275] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.341540] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.341654] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.341741] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee8b641c-b2f7-4b94-85bb-98a31dba1604 is going to be updated. [ 1196.376568] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.376755] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.376794] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.377034] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.377196] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.389204] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee8b641c-b2f7-4b94-85bb-98a31dba1604 in Status: IN_PROGRESS for 2s [ 1197.224694] env[70392]: INFO networking_nsxv3.common.synchronization [req-43a57288-627a-4887-ad42-8c1d53794dab req-3afee668-31f9-4d50-a7a9-ee0229784493 tempest-ServersTestJSON-507292717 tempest-ServersTestJSON-507292717-project-member] Enqueued Resource ID: 19062702-bd29-4477-a732-5169f347b4da with Priority: HIGHEST for action security_group_members [ 1197.225252] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19062702-bd29-4477-a732-5169f347b4da with Priority: HIGHEST for action security_group_members [ 1197.225555] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-19062702-bd29-4477-a732-5169f347b4da taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.225679] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.225746] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.225945] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.226391] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.226391] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.226391] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.226553] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.226553] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.226609] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.302771] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 in Status: SUCCESS [ 1197.303040] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.303249] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.303481] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.303658] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.303780] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.303872] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.303996] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.304096] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.304194] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('81234d09-eeda-4e4f-bbe7-9aa250a3b427',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.728219] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.807163] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.807424] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.807424] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.807601] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.807693] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.807879] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.808061] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.808138] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.808281] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.808358] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.808445] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 is going to be updated. [ 1197.840337] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.840603] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.840654] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.840927] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.841098] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.854317] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 in Status: IN_PROGRESS for 2s [ 1197.895477] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-219 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.895674] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-219" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.895804] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-219" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.896079] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-219" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.896330] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.896491] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.896615] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.896868] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.897216] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.897508] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1197.897637] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1197.897755] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1197.897871] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1197.898071] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1197.898174] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1197.898254] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1197.916447] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1197.916631] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1197.916779] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1197.916960] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-219" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.917358] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-30dce545-ee46-4d74-b5c8-90702e02c8dc taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.917540] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-30dce545-ee46-4d74-b5c8-90702e02c8dc" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.917664] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-30dce545-ee46-4d74-b5c8-90702e02c8dc" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.917995] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-30dce545-ee46-4d74-b5c8-90702e02c8dc" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.918160] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('30dce545-ee46-4d74-b5c8-90702e02c8dc',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.230494] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.399306] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee8b641c-b2f7-4b94-85bb-98a31dba1604 in Status: SUCCESS [ 1198.399524] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee8b641c-b2f7-4b94-85bb-98a31dba1604" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.399742] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee8b641c-b2f7-4b94-85bb-98a31dba1604" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.399994] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee8b641c-b2f7-4b94-85bb-98a31dba1604" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.400260] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.400393] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.400471] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.400651] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.400831] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.400955] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee8b641c-b2f7-4b94-85bb-98a31dba1604" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.401110] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ee8b641c-b2f7-4b94-85bb-98a31dba1604',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.421386] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.421607] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.421740] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.422035] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.422197] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.422410] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 30dce545-ee46-4d74-b5c8-90702e02c8dc not found, creating... [ 1198.422704] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.422872] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.422997] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.423244] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.423389] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.423675] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.423893] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.423954] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.424176] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.424331] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.424479] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 30dce545-ee46-4d74-b5c8-90702e02c8dc is going to be created. [ 1198.444380] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.444653] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.444828] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.445193] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.445454] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.445709] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-30dce545-ee46-4d74-b5c8-90702e02c8dc" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.733383] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.733383] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.733699] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.733699] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.733760] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.733930] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19062702-bd29-4477-a732-5169f347b4da is going to be updated. [ 1198.770208] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.770417] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.770490] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.770692] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.770852] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.782606] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19062702-bd29-4477-a732-5169f347b4da in Status: IN_PROGRESS for 2s [ 1198.903137] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ee8b641c-b2f7-4b94-85bb-98a31dba1604',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.310590] env[70392]: INFO networking_nsxv3.common.synchronization [req-43a57288-627a-4887-ad42-8c1d53794dab req-916fcbf2-f754-4067-b7c6-8823f88e63e7 service nova] Enqueued Resource ID: 19062702-bd29-4477-a732-5169f347b4da with Priority: HIGHEST for action security_group_rules [ 1199.311416] env[70392]: INFO networking_nsxv3.common.synchronization [req-43a57288-627a-4887-ad42-8c1d53794dab req-916fcbf2-f754-4067-b7c6-8823f88e63e7 service nova] Enqueued Resource ID: 19062702-bd29-4477-a732-5169f347b4da with Priority: HIGHEST for action security_group_members [ 1199.311416] env[70392]: INFO networking_nsxv3.common.synchronization [req-43a57288-627a-4887-ad42-8c1d53794dab req-916fcbf2-f754-4067-b7c6-8823f88e63e7 service nova] Enqueued Resource ID: 30dce545-ee46-4d74-b5c8-90702e02c8dc with Priority: HIGHEST for action port [ 1199.314746] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19062702-bd29-4477-a732-5169f347b4da with Priority: HIGHEST for action security_group_rules [ 1199.317092] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19062702-bd29-4477-a732-5169f347b4da with Priority: HIGHEST for action security_group_members [ 1199.317092] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30dce545-ee46-4d74-b5c8-90702e02c8dc with Priority: HIGHEST for action port [ 1199.317092] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-19062702-bd29-4477-a732-5169f347b4da taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.317092] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.317499] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.317783] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.317975] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.319459] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-19062702-bd29-4477-a732-5169f347b4da taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.319691] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.320649] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-30dce545-ee46-4d74-b5c8-90702e02c8dc taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.320649] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-30dce545-ee46-4d74-b5c8-90702e02c8dc" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.320649] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-30dce545-ee46-4d74-b5c8-90702e02c8dc" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.320649] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-30dce545-ee46-4d74-b5c8-90702e02c8dc" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.320649] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('30dce545-ee46-4d74-b5c8-90702e02c8dc',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.406892] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ee8b641c-b2f7-4b94-85bb-98a31dba1604: rpc.has_security_group_logging(os_id): False [ 1199.427848] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.428072] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.428072] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.428273] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.451812] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.451812] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.452010] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.452010] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.452264] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.452378] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.452518] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee8b641c-b2f7-4b94-85bb-98a31dba1604 is going to be updated. [ 1199.527799] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.527960] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.528108] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.528289] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.528445] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.543079] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee8b641c-b2f7-4b94-85bb-98a31dba1604 in Status: IN_PROGRESS for 2s [ 1199.823382] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-19062702-bd29-4477-a732-5169f347b4da taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.826076] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.826076] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 30dce545-ee46-4d74-b5c8-90702e02c8dc with status ACTIVE [ 1199.826076] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.826076] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.826076] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.826076] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.826076] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.826076] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.826076] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.826076] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.826076] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.826076] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.826076] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.826076] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.826076] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.826076] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.826623] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.829642] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 30dce545-ee46-4d74-b5c8-90702e02c8dc is going to be updated. [ 1199.851394] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.851738] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.851738] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.851904] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.852733] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.853025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-30dce545-ee46-4d74-b5c8-90702e02c8dc" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.867507] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 in Status: SUCCESS [ 1199.867702] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 deletion is rescheduled due to dependency. [ 1199.867872] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.868081] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.868306] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.868486] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.868602] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.868661] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.868816] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.870155] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.870281] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('81234d09-eeda-4e4f-bbe7-9aa250a3b427',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.374418] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.374737] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.374737] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.374869] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.374963] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.375253] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.375365] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.375429] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.375593] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.375727] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.375787] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 is going to be updated. [ 1200.405395] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.405560] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.405632] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.405860] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.406009] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.415790] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 in Status: IN_PROGRESS for 2s [ 1200.797250] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19062702-bd29-4477-a732-5169f347b4da in Status: SUCCESS [ 1200.797502] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.797743] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.797989] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.798258] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.798406] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.798497] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.798732] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.798825] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.798924] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.301911] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.525119] env[70392]: INFO networking_nsxv3.common.synchronization [req-ad6df727-8748-4790-b876-c4921d75e9c6 req-33cea88f-7cc2-499f-98d0-6c945a87061f tempest-ImagesTestJSON-499820929 tempest-ImagesTestJSON-499820929-project-member] Enqueued Resource ID: bca01ddc-73d5-4856-bbff-aefad642492a with Priority: HIGHEST for action security_group_members [ 1201.528139] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bca01ddc-73d5-4856-bbff-aefad642492a with Priority: HIGHEST for action security_group_members [ 1201.528804] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-bca01ddc-73d5-4856-bbff-aefad642492a taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.528937] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.529012] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.529229] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.529395] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.529502] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.529580] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.529754] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.529847] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.529942] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bca01ddc-73d5-4856-bbff-aefad642492a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.569101] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee8b641c-b2f7-4b94-85bb-98a31dba1604 in Status: SUCCESS [ 1201.569101] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee8b641c-b2f7-4b94-85bb-98a31dba1604" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.804470] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.032414] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.032609] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.032652] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.032859] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.033112] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.033427] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.033427] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.033427] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.033555] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.033555] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.033638] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bca01ddc-73d5-4856-bbff-aefad642492a is going to be updated. [ 1202.077026] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.077026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.077026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.077026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.077026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.090880] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bca01ddc-73d5-4856-bbff-aefad642492a in Status: IN_PROGRESS for 2s [ 1202.308903] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.308903] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.308903] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.308903] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.308903] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.308903] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19062702-bd29-4477-a732-5169f347b4da is going to be updated. [ 1202.350254] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.350478] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.350648] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.351643] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.351897] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.367414] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19062702-bd29-4477-a732-5169f347b4da in Status: IN_PROGRESS for 2s [ 1202.373274] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-328 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.373591] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.373807] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.374226] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.375159] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.375400] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.375602] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.375973] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.376235] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.376567] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1202.376767] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1202.377120] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1202.377213] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1202.377411] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1202.377605] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1202.377833] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1202.409898] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1202.410133] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1202.410308] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1202.410512] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.410842] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-2ec2fbec-6c4e-4a41-b0cb-99694c7a3b82 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.411045] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-2ec2fbec-6c4e-4a41-b0cb-99694c7a3b82" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.411166] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-2ec2fbec-6c4e-4a41-b0cb-99694c7a3b82" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.411457] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-2ec2fbec-6c4e-4a41-b0cb-99694c7a3b82" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.411596] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ec2fbec-6c4e-4a41-b0cb-99694c7a3b82',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.430697] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 in Status: SUCCESS [ 1202.430896] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 deletion is rescheduled due to dependency. [ 1202.431032] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.914535] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.914918] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.914918] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.915610] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.915610] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.916532] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.916761] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.916892] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.917331] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.917606] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.917964] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.918168] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.918317] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.918603] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.918781] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.918937] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 2ec2fbec-6c4e-4a41-b0cb-99694c7a3b82 is going to be updated. [ 1202.948359] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.948359] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.948359] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.948359] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.948359] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.948782] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-2ec2fbec-6c4e-4a41-b0cb-99694c7a3b82" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.991138] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-657 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.991401] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-657" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.991509] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-657" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.991804] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-657" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.992086] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.992254] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.992376] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.992607] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.992759] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.992978] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1202.993110] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1202.993228] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1202.993340] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1202.993455] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1202.993566] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1202.993704] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1203.044785] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1203.044785] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.051 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1203.044785] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1203.045228] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-657" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.045425] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-9269b225-75e0-47ce-a7c2-5da9a065ea61 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.045635] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-9269b225-75e0-47ce-a7c2-5da9a065ea61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.045765] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-9269b225-75e0-47ce-a7c2-5da9a065ea61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.046315] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-9269b225-75e0-47ce-a7c2-5da9a065ea61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.047031] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9269b225-75e0-47ce-a7c2-5da9a065ea61',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.549156] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.549506] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.549682] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.550013] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.550222] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.550565] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.550737] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.550862] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.551117] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.551264] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.551555] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.551712] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.551835] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.552067] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.552241] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.552403] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 9269b225-75e0-47ce-a7c2-5da9a065ea61 is going to be updated. [ 1203.576254] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.576479] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.576610] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.576891] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.577150] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.577427] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-9269b225-75e0-47ce-a7c2-5da9a065ea61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.643949] env[70392]: INFO networking_nsxv3.common.synchronization [req-9d13a0c8-28ec-4636-90d1-f4ff2f53ddbe req-2ff5fdbe-ce9d-4380-b70c-3988ac3aa4ce service nova] Enqueued Resource ID: 3507e503-4abd-47ec-8347-82fc9e691881 with Priority: HIGHEST for action security_group_rules [ 1203.644145] env[70392]: INFO networking_nsxv3.common.synchronization [req-9d13a0c8-28ec-4636-90d1-f4ff2f53ddbe req-2ff5fdbe-ce9d-4380-b70c-3988ac3aa4ce service nova] Enqueued Resource ID: 3507e503-4abd-47ec-8347-82fc9e691881 with Priority: HIGHEST for action security_group_members [ 1203.644298] env[70392]: INFO networking_nsxv3.common.synchronization [req-9d13a0c8-28ec-4636-90d1-f4ff2f53ddbe req-2ff5fdbe-ce9d-4380-b70c-3988ac3aa4ce service nova] Enqueued Resource ID: 2ec2fbec-6c4e-4a41-b0cb-99694c7a3b82 with Priority: HIGHEST for action port [ 1203.644521] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3507e503-4abd-47ec-8347-82fc9e691881 with Priority: HIGHEST for action security_group_rules [ 1203.644646] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3507e503-4abd-47ec-8347-82fc9e691881 with Priority: HIGHEST for action security_group_members [ 1203.644739] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ec2fbec-6c4e-4a41-b0cb-99694c7a3b82 with Priority: HIGHEST for action port [ 1203.645972] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3507e503-4abd-47ec-8347-82fc9e691881 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.646127] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.646197] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.646402] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.646486] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3507e503-4abd-47ec-8347-82fc9e691881',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.647457] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-3507e503-4abd-47ec-8347-82fc9e691881 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.647666] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.647761] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.648056] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.787295] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.787528] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.787528] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.787781] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.787877] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.787980] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3507e503-4abd-47ec-8347-82fc9e691881',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.789098] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-2ec2fbec-6c4e-4a41-b0cb-99694c7a3b82 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.789213] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2ec2fbec-6c4e-4a41-b0cb-99694c7a3b82" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.789245] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2ec2fbec-6c4e-4a41-b0cb-99694c7a3b82" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.789439] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2ec2fbec-6c4e-4a41-b0cb-99694c7a3b82" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.789502] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ec2fbec-6c4e-4a41-b0cb-99694c7a3b82',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.101570] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bca01ddc-73d5-4856-bbff-aefad642492a in Status: SUCCESS [ 1204.101924] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bca01ddc-73d5-4856-bbff-aefad642492a deletion is rescheduled due to dependency. [ 1204.101924] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.236455] env[70392]: INFO networking_nsxv3.common.synchronization [req-9caba16d-1fd5-4af8-baf9-b29e109ab0fc req-91f8d0ad-4a66-4967-be87-ac1ab51828a9 service nova] Enqueued Resource ID: c3e59ae3-629d-4146-9bee-ef9808a03841 with Priority: HIGHEST for action security_group_rules [ 1204.236455] env[70392]: INFO networking_nsxv3.common.synchronization [req-9caba16d-1fd5-4af8-baf9-b29e109ab0fc req-91f8d0ad-4a66-4967-be87-ac1ab51828a9 service nova] Enqueued Resource ID: c3e59ae3-629d-4146-9bee-ef9808a03841 with Priority: HIGHEST for action security_group_members [ 1204.236455] env[70392]: INFO networking_nsxv3.common.synchronization [req-9caba16d-1fd5-4af8-baf9-b29e109ab0fc req-91f8d0ad-4a66-4967-be87-ac1ab51828a9 service nova] Enqueued Resource ID: 9269b225-75e0-47ce-a7c2-5da9a065ea61 with Priority: HIGHEST for action port [ 1204.236455] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3e59ae3-629d-4146-9bee-ef9808a03841 with Priority: HIGHEST for action security_group_rules [ 1204.236455] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3e59ae3-629d-4146-9bee-ef9808a03841 with Priority: HIGHEST for action security_group_members [ 1204.236455] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9269b225-75e0-47ce-a7c2-5da9a065ea61 with Priority: HIGHEST for action port [ 1204.238836] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c3e59ae3-629d-4146-9bee-ef9808a03841 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.239010] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.239095] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.239306] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.239435] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c3e59ae3-629d-4146-9bee-ef9808a03841',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.240361] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3e59ae3-629d-4146-9bee-ef9808a03841 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.240463] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.240574] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.240720] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.240877] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.240995] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.241068] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.241217] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.241313] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.241396] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c3e59ae3-629d-4146-9bee-ef9808a03841',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.242157] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-9269b225-75e0-47ce-a7c2-5da9a065ea61 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.242272] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9269b225-75e0-47ce-a7c2-5da9a065ea61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.242314] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9269b225-75e0-47ce-a7c2-5da9a065ea61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.242453] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9269b225-75e0-47ce-a7c2-5da9a065ea61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.242519] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9269b225-75e0-47ce-a7c2-5da9a065ea61',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.291223] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-3507e503-4abd-47ec-8347-82fc9e691881 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.291372] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.291598] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3507e503-4abd-47ec-8347-82fc9e691881',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.292520] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2ec2fbec-6c4e-4a41-b0cb-99694c7a3b82 with status ACTIVE [ 1204.292714] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.292821] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.292888] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.293884] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.293884] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.293884] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.293884] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.293884] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.293884] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.293884] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.294197] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.294197] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.294197] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.294300] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.294370] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.294529] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2ec2fbec-6c4e-4a41-b0cb-99694c7a3b82 is going to be updated. [ 1204.317773] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.317945] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.317945] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.318078] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.318219] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.318385] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2ec2fbec-6c4e-4a41-b0cb-99694c7a3b82" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.382935] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19062702-bd29-4477-a732-5169f347b4da in Status: SUCCESS [ 1204.383196] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.383385] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.383654] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.383856] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.383978] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.384048] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.384211] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.384289] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.384378] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.384490] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.744761] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3e59ae3-629d-4146-9bee-ef9808a03841 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.744761] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.746762] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c3e59ae3-629d-4146-9bee-ef9808a03841',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.746999] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9269b225-75e0-47ce-a7c2-5da9a065ea61 with status ACTIVE [ 1204.747253] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.747372] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.747434] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.747638] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.747726] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.747948] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.748139] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.748237] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.748443] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.748529] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.748721] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.748812] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.748871] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.749018] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.749095] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.749178] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9269b225-75e0-47ce-a7c2-5da9a065ea61 is going to be updated. [ 1204.775154] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.775154] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.775154] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.775154] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.775154] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.775461] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9269b225-75e0-47ce-a7c2-5da9a065ea61" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.796970] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3507e503-4abd-47ec-8347-82fc9e691881',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.886836] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-19062702-bd29-4477-a732-5169f347b4da taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.887166] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.887166] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.887366] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.887551] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.887674] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.887734] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.887892] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.887993] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.888103] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.888255] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-19062702-bd29-4477-a732-5169f347b4da taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.888349] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.888431] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.888626] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.888797] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.888903] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.888964] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.889117] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.889200] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.889319] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.889417] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.251712] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c3e59ae3-629d-4146-9bee-ef9808a03841',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.299592] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.299798] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.299843] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.300316] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.300539] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.300678] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3507e503-4abd-47ec-8347-82fc9e691881 is going to be updated. [ 1205.338702] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.338922] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.338922] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.339234] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.339424] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.351750] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3507e503-4abd-47ec-8347-82fc9e691881 in Status: IN_PROGRESS for 2s [ 1205.391600] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 19062702-bd29-4477-a732-5169f347b4da: rpc.has_security_group_logging(os_id): False [ 1205.418103] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.418312] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.418374] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.418637] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.418729] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.418967] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.419554] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.419554] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.419554] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.419554] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.419554] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.419835] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.419835] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.419835] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.419927] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.420097] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.420286] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.420398] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.420560] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.420635] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.420745] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 19062702-bd29-4477-a732-5169f347b4da is going to be updated. [ 1205.509598] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.509811] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.509891] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.510411] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.510411] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.531792] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 19062702-bd29-4477-a732-5169f347b4da in Status: IN_PROGRESS for 2s [ 1205.755050] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.755050] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.755050] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.755050] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.755333] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.755333] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3e59ae3-629d-4146-9bee-ef9808a03841 is going to be updated. [ 1205.801821] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.802040] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.802123] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.802339] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.802492] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.817377] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3e59ae3-629d-4146-9bee-ef9808a03841 in Status: IN_PROGRESS for 2s [ 1207.368990] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3507e503-4abd-47ec-8347-82fc9e691881 in Status: SUCCESS [ 1207.369277] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.369433] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.369714] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.369914] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.370044] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.370113] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.370272] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.370356] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.370440] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.370532] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3507e503-4abd-47ec-8347-82fc9e691881',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.554079] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 19062702-bd29-4477-a732-5169f347b4da in Status: SUCCESS [ 1207.554315] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.828242] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3e59ae3-629d-4146-9bee-ef9808a03841 in Status: SUCCESS [ 1207.828582] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.828807] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.829108] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.829349] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.829504] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.829580] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.829818] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.829893] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.830010] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.830121] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c3e59ae3-629d-4146-9bee-ef9808a03841',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.873627] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-3507e503-4abd-47ec-8347-82fc9e691881 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.873834] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.874072] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.876340] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.876602] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.876744] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.876829] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.877104] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.877291] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.877420] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.877590] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-3507e503-4abd-47ec-8347-82fc9e691881 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.877686] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.877775] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.877901] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.878088] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.878154] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.878238] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.878377] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.878455] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.878534] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.878623] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3507e503-4abd-47ec-8347-82fc9e691881',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.333051] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3e59ae3-629d-4146-9bee-ef9808a03841 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.333257] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.333358] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.333586] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.333764] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.334946] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.335108] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.335248] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.335343] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.335437] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.335595] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3e59ae3-629d-4146-9bee-ef9808a03841 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.335692] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.335752] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.335899] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.336052] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.336142] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.336355] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.336355] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.336447] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.336495] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.336563] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c3e59ae3-629d-4146-9bee-ef9808a03841',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.381023] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3507e503-4abd-47ec-8347-82fc9e691881: rpc.has_security_group_logging(os_id): False [ 1208.402319] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.402459] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.402528] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.403303] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.403303] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.403303] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.403303] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.403477] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.403673] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.403848] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.404060] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.404157] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.404219] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.404392] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.404488] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.404682] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.404775] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.404835] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.404973] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.405058] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.405144] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3507e503-4abd-47ec-8347-82fc9e691881 is going to be updated. [ 1208.477281] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.477468] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.477541] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.477807] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.478014] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.497573] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3507e503-4abd-47ec-8347-82fc9e691881 in Status: IN_PROGRESS for 2s [ 1208.842623] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c3e59ae3-629d-4146-9bee-ef9808a03841: rpc.has_security_group_logging(os_id): False [ 1208.866424] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.866424] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.866424] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.866424] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.904223] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.904223] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.904223] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.904223] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.904223] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.904223] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.904223] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.904223] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.904223] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.904223] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.904223] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.904223] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.904223] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.904223] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.904937] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.904937] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.904937] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c3e59ae3-629d-4146-9bee-ef9808a03841 is going to be updated. [ 1208.982872] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.983236] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.983750] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.983750] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.983946] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.005865] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c3e59ae3-629d-4146-9bee-ef9808a03841 in Status: IN_PROGRESS for 2s [ 1209.238175] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1209.238175] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1210.278105] env[70392]: INFO networking_nsxv3.common.synchronization [req-78029b97-9bf6-4c6f-84e6-b1e3f6b8ef44 req-e099fa1a-0bbc-42a4-a786-345f5b333716 tempest-ServerActionsTestJSON-648729814 tempest-ServerActionsTestJSON-648729814-project-member] Enqueued Resource ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 with Priority: HIGHEST for action security_group_members [ 1210.278800] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 with Priority: HIGHEST for action security_group_members [ 1210.279163] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.279376] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.279484] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.279758] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.280021] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.280188] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.280262] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.280478] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.280638] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.280678] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e473c6e0-5940-4d57-ba2e-d012e6d8eeb9',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.516060] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3507e503-4abd-47ec-8347-82fc9e691881 in Status: SUCCESS [ 1210.516409] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.658090] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-872 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.658340] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-872" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.658487] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-872" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.658941] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-872" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.659296] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.659574] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.660654] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.660654] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.660654] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.660654] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1210.660654] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1210.660942] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1210.660942] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1210.661030] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1210.661147] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1210.661362] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1210.681264] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1210.681553] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1210.681804] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1210.682016] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-872" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.682443] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-d6d1a766-5106-402b-824d-e1bc58a67d04 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.682718] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-d6d1a766-5106-402b-824d-e1bc58a67d04" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.683339] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-d6d1a766-5106-402b-824d-e1bc58a67d04" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.683339] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-d6d1a766-5106-402b-824d-e1bc58a67d04" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.683557] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6d1a766-5106-402b-824d-e1bc58a67d04',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.782968] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.783195] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.783195] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.783686] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.783686] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.783916] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.784109] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.784239] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.784344] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.784424] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.784530] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 already deleted. [ 1210.784625] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.022356] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c3e59ae3-629d-4146-9bee-ef9808a03841 in Status: SUCCESS [ 1211.022601] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.186955] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.187151] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.187293] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.187678] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.187892] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.188117] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port d6d1a766-5106-402b-824d-e1bc58a67d04 not found, creating... [ 1211.188493] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.188765] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.188990] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.189382] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.189669] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.190145] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.190408] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.190619] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.190977] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.191241] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.191503] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: d6d1a766-5106-402b-824d-e1bc58a67d04 is going to be created. [ 1211.220348] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.220597] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.220718] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.220998] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.221255] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.221515] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-d6d1a766-5106-402b-824d-e1bc58a67d04" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.915295] env[70392]: INFO networking_nsxv3.common.synchronization [req-78029b97-9bf6-4c6f-84e6-b1e3f6b8ef44 req-eabfcce1-e3c8-4278-9695-9acc09a78136 service nova] Enqueued Resource ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 with Priority: HIGHEST for action security_group_rules [ 1211.915295] env[70392]: INFO networking_nsxv3.common.synchronization [req-78029b97-9bf6-4c6f-84e6-b1e3f6b8ef44 req-eabfcce1-e3c8-4278-9695-9acc09a78136 service nova] Enqueued Resource ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 with Priority: HIGHEST for action security_group_members [ 1211.915295] env[70392]: INFO networking_nsxv3.common.synchronization [req-78029b97-9bf6-4c6f-84e6-b1e3f6b8ef44 req-eabfcce1-e3c8-4278-9695-9acc09a78136 service nova] Enqueued Resource ID: d6d1a766-5106-402b-824d-e1bc58a67d04 with Priority: HIGHEST for action port [ 1211.915295] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 with Priority: HIGHEST for action security_group_rules [ 1211.915295] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 with Priority: HIGHEST for action security_group_members [ 1211.915295] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6d1a766-5106-402b-824d-e1bc58a67d04 with Priority: HIGHEST for action port [ 1211.915295] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.915295] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.916062] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.916706] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.916898] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e473c6e0-5940-4d57-ba2e-d012e6d8eeb9',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.918540] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.918882] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.919065] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.919334] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.920016] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.920016] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.920016] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.920016] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.920323] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.920495] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e473c6e0-5940-4d57-ba2e-d012e6d8eeb9',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.922430] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-d6d1a766-5106-402b-824d-e1bc58a67d04 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.922430] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d6d1a766-5106-402b-824d-e1bc58a67d04" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.922430] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d6d1a766-5106-402b-824d-e1bc58a67d04" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.922430] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d6d1a766-5106-402b-824d-e1bc58a67d04" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.922430] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6d1a766-5106-402b-824d-e1bc58a67d04',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.424512] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.424649] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.424833] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d6d1a766-5106-402b-824d-e1bc58a67d04 with status ACTIVE [ 1212.425008] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.425200] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.425200] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.425402] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.425490] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.425664] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.425758] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.425820] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.425976] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.426122] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.426879] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.426879] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.426879] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.426879] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.426879] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.426879] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d6d1a766-5106-402b-824d-e1bc58a67d04 is going to be updated. [ 1212.428126] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e473c6e0-5940-4d57-ba2e-d012e6d8eeb9',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.454127] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.454637] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.455884] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.455884] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.455884] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.455884] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d6d1a766-5106-402b-824d-e1bc58a67d04" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.695021] env[70392]: INFO networking_nsxv3.common.synchronization [req-9638199e-8cea-4339-ac58-04261be1f2f2 req-3d804be4-da8e-4f62-8444-34d1f03f9fbf tempest-ServerActionsTestOtherB-779604050 tempest-ServerActionsTestOtherB-779604050-project-member] Enqueued Resource ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 with Priority: HIGHEST for action security_group_members [ 1212.695021] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 with Priority: HIGHEST for action security_group_members [ 1212.695021] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.695021] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.695021] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.695405] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.695405] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.695405] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.695505] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.695769] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.695769] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.695769] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.934020] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e473c6e0-5940-4d57-ba2e-d012e6d8eeb9',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.982030] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-452 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.982257] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-452" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.982461] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-452" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.982752] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-452" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.983043] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.983214] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.983340] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.983560] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.983900] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.984160] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1212.984302] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1212.984443] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1212.984561] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1212.984683] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1212.984799] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1212.984941] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1213.002972] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1213.003174] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1213.003318] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1213.003502] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-452" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.003822] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-65955417-6109-4d4c-b467-f660ce88a0d4 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.003996] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-65955417-6109-4d4c-b467-f660ce88a0d4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.004137] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-65955417-6109-4d4c-b467-f660ce88a0d4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.004470] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-65955417-6109-4d4c-b467-f660ce88a0d4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.004612] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65955417-6109-4d4c-b467-f660ce88a0d4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.201648] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.201904] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.201971] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.202209] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.202305] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.202510] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.202602] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.202660] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.202813] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.202876] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.202959] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 is going to be updated. [ 1213.231109] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.231319] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.231319] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.231532] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.231725] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.241583] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 in Status: IN_PROGRESS for 2s [ 1213.433919] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.434112] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.434196] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.434451] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.434550] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.434660] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 is going to be created. [ 1213.465937] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.466146] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.466146] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.466395] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.466661] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.476980] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 in Status: UNINITIALIZED for 2s [ 1213.507328] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.507611] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.507747] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.508044] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.508201] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.508407] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 65955417-6109-4d4c-b467-f660ce88a0d4 not found, creating... [ 1213.508684] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.508846] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.508969] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.509209] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.509354] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.509706] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.509885] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.510014] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.510241] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.510380] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.510529] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 65955417-6109-4d4c-b467-f660ce88a0d4 is going to be created. [ 1213.532308] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.532733] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.532733] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.533090] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.533397] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.533715] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-65955417-6109-4d4c-b467-f660ce88a0d4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.314141] env[70392]: INFO networking_nsxv3.common.synchronization [req-9638199e-8cea-4339-ac58-04261be1f2f2 req-c587200b-a071-4c11-b5ad-9fd0f4084804 service nova] Enqueued Resource ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 with Priority: HIGHEST for action security_group_rules [ 1214.314141] env[70392]: INFO networking_nsxv3.common.synchronization [req-9638199e-8cea-4339-ac58-04261be1f2f2 req-c587200b-a071-4c11-b5ad-9fd0f4084804 service nova] Enqueued Resource ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 with Priority: HIGHEST for action security_group_members [ 1214.314141] env[70392]: INFO networking_nsxv3.common.synchronization [req-9638199e-8cea-4339-ac58-04261be1f2f2 req-c587200b-a071-4c11-b5ad-9fd0f4084804 service nova] Enqueued Resource ID: 65955417-6109-4d4c-b467-f660ce88a0d4 with Priority: HIGHEST for action port [ 1214.314141] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 with Priority: HIGHEST for action security_group_rules [ 1214.314141] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 with Priority: HIGHEST for action security_group_members [ 1214.314141] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65955417-6109-4d4c-b467-f660ce88a0d4 with Priority: HIGHEST for action port [ 1214.315765] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.315765] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.315765] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.316774] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.317125] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.319411] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.320024] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.320588] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-65955417-6109-4d4c-b467-f660ce88a0d4 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.322129] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-65955417-6109-4d4c-b467-f660ce88a0d4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.322129] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-65955417-6109-4d4c-b467-f660ce88a0d4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.322129] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-65955417-6109-4d4c-b467-f660ce88a0d4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.322129] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65955417-6109-4d4c-b467-f660ce88a0d4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.824778] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.824952] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.825248] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 65955417-6109-4d4c-b467-f660ce88a0d4 with status ACTIVE [ 1214.825482] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.825651] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.825716] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.826052] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.826148] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.826361] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.826498] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.826603] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.826802] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.827327] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.827327] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.827327] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.827518] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.827586] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.828397] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.828397] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 65955417-6109-4d4c-b467-f660ce88a0d4 is going to be updated. [ 1214.856255] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.856255] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.856572] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.856572] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.856675] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.856835] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-65955417-6109-4d4c-b467-f660ce88a0d4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.252458] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 in Status: SUCCESS [ 1215.252642] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 deletion is rescheduled due to dependency. [ 1215.252828] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.253010] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.253241] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.253431] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.253552] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.253630] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.253785] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.253901] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.254050] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.487768] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 in Status: SUCCESS [ 1215.488250] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.488250] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.488427] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.488581] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.488709] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.488771] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.488922] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.489053] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.489149] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.489244] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e473c6e0-5940-4d57-ba2e-d012e6d8eeb9',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.756388] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.991725] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e473c6e0-5940-4d57-ba2e-d012e6d8eeb9',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.261192] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.495498] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e473c6e0-5940-4d57-ba2e-d012e6d8eeb9: rpc.has_security_group_logging(os_id): False [ 1216.515624] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.519050] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.519146] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.519386] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.519492] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.519759] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.519868] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.519954] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.520117] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.520194] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.520280] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 is going to be created. [ 1216.591301] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.592153] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.592321] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.592542] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.592808] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.609405] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 in Status: IN_PROGRESS for 2s [ 1216.765458] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.765708] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.765708] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.765949] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.766056] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.766165] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 is going to be updated. [ 1216.797857] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.798228] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.798228] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.798476] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.798555] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.809740] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 in Status: IN_PROGRESS for 2s [ 1216.929410] env[70392]: INFO networking_nsxv3.common.synchronization [req-46900fd3-4800-489e-a3c7-7d1e2d1b92dd req-9d11028f-c2a3-4a70-bc1d-419ab7099b0a tempest-ServersTestMultiNic-1661297721 tempest-ServersTestMultiNic-1661297721-project-member] Enqueued Resource ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 with Priority: HIGHEST for action security_group_members [ 1216.930211] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 with Priority: HIGHEST for action security_group_members [ 1216.930613] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-81234d09-eeda-4e4f-bbe7-9aa250a3b427 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.930739] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.930963] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.931110] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.931500] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.931719] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.931719] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.931947] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.932073] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.932244] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('81234d09-eeda-4e4f-bbe7-9aa250a3b427',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.418093] env[70392]: INFO networking_nsxv3.common.synchronization [req-46900fd3-4800-489e-a3c7-7d1e2d1b92dd req-7924fbaf-9fae-4a41-8023-94201d6deb11 tempest-ServersTestMultiNic-1661297721 tempest-ServersTestMultiNic-1661297721-project-member] Enqueued Resource ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 with Priority: HIGHEST for action security_group_members [ 1217.418093] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 with Priority: HIGHEST for action security_group_members [ 1217.418093] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-81234d09-eeda-4e4f-bbe7-9aa250a3b427 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.418093] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.437773] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.437773] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.437773] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.437773] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.437773] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.437773] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.437773] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.437773] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.437773] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.437773] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.437773] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 is going to be updated. [ 1217.468038] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.468038] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.468038] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.468038] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.468038] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.479329] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 in Status: IN_PROGRESS for 2s [ 1217.789945] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-187 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.790348] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-187" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.790348] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-187" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.790685] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-187" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.791009] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.791237] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.791383] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.791663] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.791847] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.792155] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1217.792341] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1217.792442] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1217.792585] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1217.792773] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1217.792919] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1217.793157] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1217.815091] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1217.815650] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1217.815848] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1217.816126] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-187" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.816516] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-4ab59fb3-c8a6-4c2f-8651-ab60430f67a8 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.816804] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-4ab59fb3-c8a6-4c2f-8651-ab60430f67a8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.817657] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-4ab59fb3-c8a6-4c2f-8651-ab60430f67a8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.818188] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-4ab59fb3-c8a6-4c2f-8651-ab60430f67a8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.818373] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4ab59fb3-c8a6-4c2f-8651-ab60430f67a8',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.321324] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.321628] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.321723] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.322052] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.322231] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.322450] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 4ab59fb3-c8a6-4c2f-8651-ab60430f67a8 not found, creating... [ 1218.322791] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.323014] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.323160] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.323420] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.323573] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.323898] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.324093] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.324223] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.324463] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.324620] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.324771] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 4ab59fb3-c8a6-4c2f-8651-ab60430f67a8 is going to be created. [ 1218.349067] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.349413] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.349503] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.349850] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.350193] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.350504] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-4ab59fb3-c8a6-4c2f-8651-ab60430f67a8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.632527] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 in Status: SUCCESS [ 1218.632846] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.819492] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 in Status: SUCCESS [ 1218.819802] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.819868] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.820095] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.820290] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.820445] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.820512] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.820653] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.820735] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.820817] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.820907] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.174187] env[70392]: INFO networking_nsxv3.common.synchronization [req-d5ad593c-227d-438d-9733-6d4c8b80d1b5 req-9ae1d4f6-98c0-477a-b398-82b02c100b3f tempest-AttachInterfacesTestJSON-2046649887 tempest-AttachInterfacesTestJSON-2046649887-project-member] Enqueued Resource ID: 73f697c6-7f54-4f76-8856-ccf1651be1c2 with Priority: HIGHEST for action security_group_members [ 1219.174793] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73f697c6-7f54-4f76-8856-ccf1651be1c2 with Priority: HIGHEST for action security_group_members [ 1219.175110] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-73f697c6-7f54-4f76-8856-ccf1651be1c2 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.175234] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73f697c6-7f54-4f76-8856-ccf1651be1c2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.175297] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73f697c6-7f54-4f76-8856-ccf1651be1c2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.175504] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73f697c6-7f54-4f76-8856-ccf1651be1c2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.175679] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.175750] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.175816] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.176086] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.176086] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.176169] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('73f697c6-7f54-4f76-8856-ccf1651be1c2',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.183112] env[70392]: INFO networking_nsxv3.common.synchronization [req-0e884442-5007-46aa-b254-742c3a966896 req-44ebd524-af43-431a-a56a-2a7113df504e tempest-AttachVolumeNegativeTest-772339566 tempest-AttachVolumeNegativeTest-772339566-project-member] Enqueued Resource ID: 25d71d6e-f381-40cd-b3d0-6c5c495c4c87 with Priority: HIGHEST for action security_group_members [ 1219.183817] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25d71d6e-f381-40cd-b3d0-6c5c495c4c87 with Priority: HIGHEST for action security_group_members [ 1219.184158] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-25d71d6e-f381-40cd-b3d0-6c5c495c4c87 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.184306] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25d71d6e-f381-40cd-b3d0-6c5c495c4c87" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.184407] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25d71d6e-f381-40cd-b3d0-6c5c495c4c87" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.184926] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25d71d6e-f381-40cd-b3d0-6c5c495c4c87" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.184926] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.184926] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.185110] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.185225] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.185339] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.185481] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25d71d6e-f381-40cd-b3d0-6c5c495c4c87',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.323858] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.348724] env[70392]: INFO networking_nsxv3.common.synchronization [req-46900fd3-4800-489e-a3c7-7d1e2d1b92dd req-98ae4d05-d2f0-4071-bec3-6cb2b08c9937 service nova] Enqueued Resource ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 with Priority: HIGHEST for action security_group_rules [ 1219.348917] env[70392]: INFO networking_nsxv3.common.synchronization [req-46900fd3-4800-489e-a3c7-7d1e2d1b92dd req-98ae4d05-d2f0-4071-bec3-6cb2b08c9937 service nova] Enqueued Resource ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 with Priority: HIGHEST for action security_group_members [ 1219.349073] env[70392]: INFO networking_nsxv3.common.synchronization [req-46900fd3-4800-489e-a3c7-7d1e2d1b92dd req-98ae4d05-d2f0-4071-bec3-6cb2b08c9937 service nova] Enqueued Resource ID: 4ab59fb3-c8a6-4c2f-8651-ab60430f67a8 with Priority: HIGHEST for action port [ 1219.349754] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 with Priority: HIGHEST for action security_group_rules [ 1219.349884] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 with Priority: HIGHEST for action security_group_members [ 1219.349980] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ab59fb3-c8a6-4c2f-8651-ab60430f67a8 with Priority: HIGHEST for action port [ 1219.350292] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-81234d09-eeda-4e4f-bbe7-9aa250a3b427 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.350412] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.350556] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.351137] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.351137] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('81234d09-eeda-4e4f-bbe7-9aa250a3b427',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.351656] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-81234d09-eeda-4e4f-bbe7-9aa250a3b427 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.351741] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.351924] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-4ab59fb3-c8a6-4c2f-8651-ab60430f67a8 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.352018] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4ab59fb3-c8a6-4c2f-8651-ab60430f67a8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.353201] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4ab59fb3-c8a6-4c2f-8651-ab60430f67a8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.353201] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4ab59fb3-c8a6-4c2f-8651-ab60430f67a8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.353201] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4ab59fb3-c8a6-4c2f-8651-ab60430f67a8',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.493550] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 in Status: SUCCESS [ 1219.496421] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 deletion is rescheduled due to dependency. [ 1219.496421] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.496421] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.496421] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.496421] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.496421] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.496421] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.496421] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.496421] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.496421] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('81234d09-eeda-4e4f-bbe7-9aa250a3b427',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.539342] env[70392]: INFO networking_nsxv3.common.synchronization [req-94bfe1d0-9884-4cd4-ad74-dba3d4bf72e9 req-bacb7434-cd8d-40e8-847d-930879a18c41 tempest-ServersTestJSON-507292717 tempest-ServersTestJSON-507292717-project-member] Enqueued Resource ID: 19062702-bd29-4477-a732-5169f347b4da with Priority: HIGHEST for action security_group_members [ 1219.539342] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19062702-bd29-4477-a732-5169f347b4da with Priority: HIGHEST for action security_group_members [ 1219.539622] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-19062702-bd29-4477-a732-5169f347b4da taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.540534] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.540534] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.540534] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.540804] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.540858] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.541057] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.541193] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.541276] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.541367] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.677860] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('73f697c6-7f54-4f76-8856-ccf1651be1c2',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.689577] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.689740] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.689831] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.691210] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.691481] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.691572] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.691789] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.691789] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.691980] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.691980] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.692110] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25d71d6e-f381-40cd-b3d0-6c5c495c4c87 is going to be updated. [ 1219.726448] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.726670] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.726746] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.726908] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.727072] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.738140] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25d71d6e-f381-40cd-b3d0-6c5c495c4c87 in Status: IN_PROGRESS for 2s [ 1219.824920] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5: rpc.has_security_group_logging(os_id): False [ 1219.843948] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.844383] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.844383] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.844524] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.846613] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.846613] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.846613] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.846613] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.846613] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.846613] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.846613] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 is going to be updated. [ 1219.854148] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-81234d09-eeda-4e4f-bbe7-9aa250a3b427 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.854304] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.854501] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4ab59fb3-c8a6-4c2f-8651-ab60430f67a8 with status ACTIVE [ 1219.854681] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.854800] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.854982] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.855134] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.855219] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.855405] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.855507] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.855573] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.856528] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.856667] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.856823] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.856922] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.856987] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.857160] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.857239] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.857327] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4ab59fb3-c8a6-4c2f-8651-ab60430f67a8 is going to be updated. [ 1219.881228] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.881435] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.881478] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.881703] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.881861] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.882281] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4ab59fb3-c8a6-4c2f-8651-ab60430f67a8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.916688] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.916866] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.916905] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.917140] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.917295] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.932963] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 in Status: IN_PROGRESS for 2s [ 1220.002454] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('81234d09-eeda-4e4f-bbe7-9aa250a3b427',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.032304] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-219 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.032538] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-219" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.032673] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-219" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.032946] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-219" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.034747] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.034747] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.034747] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.035247] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.035487] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.035913] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1220.035913] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1220.036297] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1220.036496] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1220.036672] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1220.037273] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1220.037273] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1220.043809] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.069038] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1220.069038] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1220.069038] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1220.069038] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-219" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.069038] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-f64b253b-4903-43b8-aac8-f457afec12a4 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.069038] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-f64b253b-4903-43b8-aac8-f457afec12a4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.069038] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-f64b253b-4903-43b8-aac8-f457afec12a4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.069038] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-f64b253b-4903-43b8-aac8-f457afec12a4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.069775] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f64b253b-4903-43b8-aac8-f457afec12a4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.180691] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('73f697c6-7f54-4f76-8856-ccf1651be1c2',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.293797] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-376 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.294010] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-376" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.294142] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-376" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.294593] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-376" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.294929] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.295131] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.295262] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.295527] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.295679] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.295963] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1220.296106] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1220.296224] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1220.296337] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1220.296454] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1220.296559] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1220.296698] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1220.317660] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1220.317859] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1220.318069] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1220.318284] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-376" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.318726] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-902a063a-4998-4b68-aa47-700104157972 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.318920] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-902a063a-4998-4b68-aa47-700104157972" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.319066] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-902a063a-4998-4b68-aa47-700104157972" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.319405] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-902a063a-4998-4b68-aa47-700104157972" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.319552] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('902a063a-4998-4b68-aa47-700104157972',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.511033] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('81234d09-eeda-4e4f-bbe7-9aa250a3b427',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.545893] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.571976] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.572134] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.572256] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.572584] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.572731] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.572866] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port f64b253b-4903-43b8-aac8-f457afec12a4 not found, creating... [ 1220.573731] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.573731] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.573879] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.574070] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.574228] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.575021] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.575021] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.575021] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.575021] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.575254] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.575287] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: f64b253b-4903-43b8-aac8-f457afec12a4 is going to be created. [ 1220.597560] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.597835] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.597975] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.598271] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.598774] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.598774] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-f64b253b-4903-43b8-aac8-f457afec12a4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.683243] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.683478] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.683624] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.683959] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.683959] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.684040] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73f697c6-7f54-4f76-8856-ccf1651be1c2 is going to be updated. [ 1220.725745] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.725891] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.725968] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.726303] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.726513] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.738291] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73f697c6-7f54-4f76-8856-ccf1651be1c2 in Status: IN_PROGRESS for 2s [ 1220.822065] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.822346] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.822477] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.822774] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.822954] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.823141] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 902a063a-4998-4b68-aa47-700104157972 not found, creating... [ 1220.823441] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.823598] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.823839] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.823952] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.824107] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.824410] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.824568] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.824787] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.824950] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.825199] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.825272] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 902a063a-4998-4b68-aa47-700104157972 is going to be created. [ 1220.856868] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.857711] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.857711] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.857991] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.858547] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.858547] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-902a063a-4998-4b68-aa47-700104157972" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.015616] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.015616] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.015616] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.015616] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.015616] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.015616] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 is going to be updated. [ 1221.052026] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.052026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.052026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.052026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.052026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.052026] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.052026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.052026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.052026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.052687] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.052891] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19062702-bd29-4477-a732-5169f347b4da is going to be updated. [ 1221.064562] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 in Status: IN_PROGRESS for 2s [ 1221.090906] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.090906] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.090906] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.090906] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.090906] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.108569] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19062702-bd29-4477-a732-5169f347b4da in Status: IN_PROGRESS for 2s [ 1221.595184] env[70392]: INFO networking_nsxv3.common.synchronization [req-94bfe1d0-9884-4cd4-ad74-dba3d4bf72e9 req-0cd6025a-8543-41bb-9fb7-dba31866b3d5 service nova] Enqueued Resource ID: 19062702-bd29-4477-a732-5169f347b4da with Priority: HIGHEST for action security_group_rules [ 1221.595416] env[70392]: INFO networking_nsxv3.common.synchronization [req-94bfe1d0-9884-4cd4-ad74-dba3d4bf72e9 req-0cd6025a-8543-41bb-9fb7-dba31866b3d5 service nova] Enqueued Resource ID: 19062702-bd29-4477-a732-5169f347b4da with Priority: HIGHEST for action security_group_members [ 1221.595663] env[70392]: INFO networking_nsxv3.common.synchronization [req-94bfe1d0-9884-4cd4-ad74-dba3d4bf72e9 req-0cd6025a-8543-41bb-9fb7-dba31866b3d5 service nova] Enqueued Resource ID: f64b253b-4903-43b8-aac8-f457afec12a4 with Priority: HIGHEST for action port [ 1221.595908] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19062702-bd29-4477-a732-5169f347b4da with Priority: HIGHEST for action security_group_rules [ 1221.596050] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19062702-bd29-4477-a732-5169f347b4da with Priority: HIGHEST for action security_group_members [ 1221.596152] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f64b253b-4903-43b8-aac8-f457afec12a4 with Priority: HIGHEST for action port [ 1221.596805] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-19062702-bd29-4477-a732-5169f347b4da taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.596935] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.597014] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.597415] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.597544] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.598368] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-19062702-bd29-4477-a732-5169f347b4da taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.598694] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.598914] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-f64b253b-4903-43b8-aac8-f457afec12a4 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.599049] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f64b253b-4903-43b8-aac8-f457afec12a4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.599110] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f64b253b-4903-43b8-aac8-f457afec12a4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.599274] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f64b253b-4903-43b8-aac8-f457afec12a4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.599369] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f64b253b-4903-43b8-aac8-f457afec12a4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.730172] env[70392]: INFO networking_nsxv3.common.synchronization [req-46900fd3-4800-489e-a3c7-7d1e2d1b92dd req-8f569dd2-bbf9-4580-aa5a-8ef306517ccc service nova] Enqueued Resource ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 with Priority: HIGHEST for action security_group_rules [ 1221.730321] env[70392]: INFO networking_nsxv3.common.synchronization [req-46900fd3-4800-489e-a3c7-7d1e2d1b92dd req-8f569dd2-bbf9-4580-aa5a-8ef306517ccc service nova] Enqueued Resource ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 with Priority: HIGHEST for action security_group_members [ 1221.730484] env[70392]: INFO networking_nsxv3.common.synchronization [req-46900fd3-4800-489e-a3c7-7d1e2d1b92dd req-8f569dd2-bbf9-4580-aa5a-8ef306517ccc service nova] Enqueued Resource ID: 902a063a-4998-4b68-aa47-700104157972 with Priority: HIGHEST for action port [ 1221.731452] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 with Priority: HIGHEST for action security_group_rules [ 1221.731650] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 with Priority: HIGHEST for action security_group_members [ 1221.731774] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 902a063a-4998-4b68-aa47-700104157972 with Priority: HIGHEST for action port [ 1221.732270] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-81234d09-eeda-4e4f-bbe7-9aa250a3b427 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.732379] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.732654] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-81234d09-eeda-4e4f-bbe7-9aa250a3b427 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.732735] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.732931] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-902a063a-4998-4b68-aa47-700104157972 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.733056] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-902a063a-4998-4b68-aa47-700104157972" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.733106] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-902a063a-4998-4b68-aa47-700104157972" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.733306] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-902a063a-4998-4b68-aa47-700104157972" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.733389] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('902a063a-4998-4b68-aa47-700104157972',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.749905] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25d71d6e-f381-40cd-b3d0-6c5c495c4c87 in Status: SUCCESS [ 1221.750844] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25d71d6e-f381-40cd-b3d0-6c5c495c4c87 deletion is rescheduled due to dependency. [ 1221.750844] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25d71d6e-f381-40cd-b3d0-6c5c495c4c87" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.948907] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 in Status: SUCCESS [ 1221.948907] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.101422] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-19062702-bd29-4477-a732-5169f347b4da taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.102478] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.102478] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f64b253b-4903-43b8-aac8-f457afec12a4 with status ACTIVE [ 1222.102478] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.102478] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.102478] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.102478] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.102478] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.102878] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.102878] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.102878] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.102878] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.103023] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.103837] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.103837] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.103837] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.103837] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.103837] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.103837] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f64b253b-4903-43b8-aac8-f457afec12a4 is going to be updated. [ 1222.126060] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.126060] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.126060] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.126303] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.126872] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.126973] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f64b253b-4903-43b8-aac8-f457afec12a4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.238462] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 902a063a-4998-4b68-aa47-700104157972 with status ACTIVE [ 1222.238783] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.238968] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.239075] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.239276] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.239367] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.239551] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.239650] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.239815] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.239907] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.239984] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.240179] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.240295] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.240365] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.240576] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.240666] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.240769] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 902a063a-4998-4b68-aa47-700104157972 is going to be updated. [ 1222.266962] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.267126] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.267199] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.267536] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.267764] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.267938] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-902a063a-4998-4b68-aa47-700104157972" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.816791] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73f697c6-7f54-4f76-8856-ccf1651be1c2 in Status: SUCCESS [ 1222.819990] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73f697c6-7f54-4f76-8856-ccf1651be1c2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.075103] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 in Status: SUCCESS [ 1223.075439] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.075617] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.075842] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.076045] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.076164] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.076223] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.076379] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.076456] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.076581] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('81234d09-eeda-4e4f-bbe7-9aa250a3b427',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.118583] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19062702-bd29-4477-a732-5169f347b4da in Status: SUCCESS [ 1223.118835] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.118982] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.119224] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.119408] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.119525] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.119586] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.119736] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.119844] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.119944] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.578646] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('81234d09-eeda-4e4f-bbe7-9aa250a3b427',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.622061] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.081467] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('81234d09-eeda-4e4f-bbe7-9aa250a3b427',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.126451] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.584684] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.584792] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.584838] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.585400] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.585400] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.585400] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 is going to be updated. [ 1224.616994] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.616994] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.616994] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.616994] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.616994] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.627925] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 in Status: IN_PROGRESS for 2s [ 1224.627925] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.627925] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.627925] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.628244] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.628244] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.628244] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19062702-bd29-4477-a732-5169f347b4da is going to be updated. [ 1224.663243] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.663435] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.663435] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.663623] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.663785] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.674446] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19062702-bd29-4477-a732-5169f347b4da in Status: IN_PROGRESS for 2s [ 1226.491901] env[70392]: INFO networking_nsxv3.common.synchronization [req-18267ba3-f968-4724-ab87-c7f66214cc03 req-bc476177-cc6a-4e90-9a85-3030d9e653b7 tempest-AttachInterfacesTestJSON-2046649887 tempest-AttachInterfacesTestJSON-2046649887-project-member] Enqueued Resource ID: 73f697c6-7f54-4f76-8856-ccf1651be1c2 with Priority: HIGHEST for action security_group_members [ 1226.492964] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73f697c6-7f54-4f76-8856-ccf1651be1c2 with Priority: HIGHEST for action security_group_members [ 1226.492964] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-73f697c6-7f54-4f76-8856-ccf1651be1c2 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.493207] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73f697c6-7f54-4f76-8856-ccf1651be1c2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.493207] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73f697c6-7f54-4f76-8856-ccf1651be1c2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.493313] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73f697c6-7f54-4f76-8856-ccf1651be1c2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.493466] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.493562] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.493625] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.493774] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.493859] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.493949] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('73f697c6-7f54-4f76-8856-ccf1651be1c2',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.636868] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 in Status: SUCCESS [ 1226.637146] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.637317] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.637563] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.637792] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.637906] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.637971] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.638150] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.638230] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.638314] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.638411] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('81234d09-eeda-4e4f-bbe7-9aa250a3b427',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.639275] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.639445] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.639644] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.639765] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.639806] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.639957] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.640017] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.640115] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('81234d09-eeda-4e4f-bbe7-9aa250a3b427',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.656454] env[70392]: INFO networking_nsxv3.common.synchronization [None req-0cec5aac-82f7-4acc-9834-c34d19c79974 tempest-AttachVolumeNegativeTest-772339566 tempest-AttachVolumeNegativeTest-772339566-project-member] Enqueued Resource ID: 2e375ce9-a326-43ce-b62b-e40b371dfd91 with Priority: HIGHEST for action security_group_rules [ 1226.656454] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e375ce9-a326-43ce-b62b-e40b371dfd91 with Priority: HIGHEST for action security_group_rules [ 1226.656454] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2e375ce9-a326-43ce-b62b-e40b371dfd91 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.656454] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2e375ce9-a326-43ce-b62b-e40b371dfd91" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.656454] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2e375ce9-a326-43ce-b62b-e40b371dfd91" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.656661] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2e375ce9-a326-43ce-b62b-e40b371dfd91" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.657103] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2e375ce9-a326-43ce-b62b-e40b371dfd91',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.683955] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19062702-bd29-4477-a732-5169f347b4da in Status: SUCCESS [ 1226.684197] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.684353] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.684563] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.684752] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.684862] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.684928] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.685099] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.685181] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.685267] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.685357] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.726317] env[70392]: INFO networking_nsxv3.common.synchronization [None req-d62b888e-5ba5-46ce-ac54-88f39f5c4b34 tempest-AttachVolumeNegativeTest-772339566 tempest-AttachVolumeNegativeTest-772339566-project-member] Enqueued Resource ID: 2e375ce9-a326-43ce-b62b-e40b371dfd91 with Priority: HIGHEST for action security_group_rules [ 1226.727409] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e375ce9-a326-43ce-b62b-e40b371dfd91 with Priority: HIGHEST for action security_group_rules [ 1226.727409] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2e375ce9-a326-43ce-b62b-e40b371dfd91 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.727409] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2e375ce9-a326-43ce-b62b-e40b371dfd91" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.996037] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.996235] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.996278] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.996480] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.996577] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.996777] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.996875] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.996938] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.997113] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.998874] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.998874] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73f697c6-7f54-4f76-8856-ccf1651be1c2 is going to be updated. [ 1227.045482] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.045766] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.045848] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.046092] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.046248] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.055719] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73f697c6-7f54-4f76-8856-ccf1651be1c2 in Status: IN_PROGRESS for 2s [ 1227.142771] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-81234d09-eeda-4e4f-bbe7-9aa250a3b427 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.142997] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.144339] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('81234d09-eeda-4e4f-bbe7-9aa250a3b427',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.185827] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.186079] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.186249] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.186858] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.186858] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.186858] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2e375ce9-a326-43ce-b62b-e40b371dfd91 already deleted. [ 1227.186858] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2e375ce9-a326-43ce-b62b-e40b371dfd91" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.187268] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-19062702-bd29-4477-a732-5169f347b4da taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.187386] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.187447] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.187733] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.187912] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.188093] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.188150] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.188281] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.188360] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.188457] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.188675] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-19062702-bd29-4477-a732-5169f347b4da taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.188773] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.188832] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.189010] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.189131] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.189229] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.189289] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.189432] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.189507] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.189600] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.189680] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.190549] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2e375ce9-a326-43ce-b62b-e40b371dfd91" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.191192] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2e375ce9-a326-43ce-b62b-e40b371dfd91" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.191311] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2e375ce9-a326-43ce-b62b-e40b371dfd91',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.646464] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('81234d09-eeda-4e4f-bbe7-9aa250a3b427',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.693369] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 19062702-bd29-4477-a732-5169f347b4da: rpc.has_security_group_logging(os_id): False [ 1227.714141] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.714392] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.714501] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.714775] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.714880] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.715163] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.715325] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.715401] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.715693] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.715778] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.715978] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.716089] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.716152] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.716315] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.716565] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.716759] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.716853] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.716917] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.717078] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.717156] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.717239] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 19062702-bd29-4477-a732-5169f347b4da is going to be updated. [ 1227.719295] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.719420] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.719498] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.719624] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.719705] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.719792] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2e375ce9-a326-43ce-b62b-e40b371dfd91 already deleted. [ 1227.719874] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2e375ce9-a326-43ce-b62b-e40b371dfd91" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.788530] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.788782] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.788877] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.789204] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.789411] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.807753] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 19062702-bd29-4477-a732-5169f347b4da in Status: IN_PROGRESS for 2s [ 1228.150573] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.150756] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.150927] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.151246] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.151427] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.151642] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 is going to be updated. [ 1228.185733] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.185938] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.185990] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.186402] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.186402] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.196471] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 in Status: IN_PROGRESS for 2s [ 1228.765172] env[70392]: INFO networking_nsxv3.common.synchronization [req-4cba7ce4-a2e1-4261-9833-a907f9f32fd1 req-b937dd32-c7ee-4d5f-b90f-73262cc78161 tempest-ServerActionsTestOtherA-1411478130 tempest-ServerActionsTestOtherA-1411478130-project-member] Enqueued Resource ID: bb62eb06-eeb8-448e-a256-ef5cfef1b811 with Priority: HIGHEST for action security_group_members [ 1228.765779] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb62eb06-eeb8-448e-a256-ef5cfef1b811 with Priority: HIGHEST for action security_group_members [ 1228.766109] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb62eb06-eeb8-448e-a256-ef5cfef1b811 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.766227] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb62eb06-eeb8-448e-a256-ef5cfef1b811" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.766296] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb62eb06-eeb8-448e-a256-ef5cfef1b811" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.766730] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb62eb06-eeb8-448e-a256-ef5cfef1b811" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.766730] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.766968] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.766968] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.767066] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.767137] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.767226] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb62eb06-eeb8-448e-a256-ef5cfef1b811',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.066704] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73f697c6-7f54-4f76-8856-ccf1651be1c2 in Status: SUCCESS [ 1229.066884] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73f697c6-7f54-4f76-8856-ccf1651be1c2 deletion is rescheduled due to dependency. [ 1229.067017] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73f697c6-7f54-4f76-8856-ccf1651be1c2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.269468] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.269705] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.269773] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.270012] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.270166] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.270385] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.270486] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.270559] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.270735] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.270817] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.270910] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb62eb06-eeb8-448e-a256-ef5cfef1b811 is going to be updated. [ 1229.299022] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.299022] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.299022] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.299022] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.299022] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.308352] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb62eb06-eeb8-448e-a256-ef5cfef1b811 in Status: IN_PROGRESS for 2s [ 1229.825119] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 19062702-bd29-4477-a732-5169f347b4da in Status: SUCCESS [ 1229.825493] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.209107] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 in Status: SUCCESS [ 1230.209405] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.209583] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.209813] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.210046] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.210174] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.210235] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.210403] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.210480] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.210567] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.210731] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-81234d09-eeda-4e4f-bbe7-9aa250a3b427 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.210823] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.210884] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.211032] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.211174] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.211249] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.211303] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.211440] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.211508] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.211586] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.211674] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('81234d09-eeda-4e4f-bbe7-9aa250a3b427',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.713599] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 81234d09-eeda-4e4f-bbe7-9aa250a3b427: rpc.has_security_group_logging(os_id): False [ 1230.733314] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.733505] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.733558] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.733772] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.733877] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.734113] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.734538] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.734538] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.734538] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.734538] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.734769] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.734865] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.734945] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.735125] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.735223] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.735428] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.735542] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.735626] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.735782] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.735863] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.735961] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 is going to be updated. [ 1230.796603] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.796800] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.796880] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.797109] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.797308] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.817218] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 in Status: IN_PROGRESS for 2s [ 1231.319658] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb62eb06-eeb8-448e-a256-ef5cfef1b811 in Status: SUCCESS [ 1231.320124] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb62eb06-eeb8-448e-a256-ef5cfef1b811 deletion is rescheduled due to dependency. [ 1231.320124] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb62eb06-eeb8-448e-a256-ef5cfef1b811" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.514919] env[70392]: INFO networking_nsxv3.common.synchronization [None req-4ad2d3a8-010f-4b50-9e45-4f9107504014 tempest-AttachInterfacesTestJSON-2046649887 tempest-AttachInterfacesTestJSON-2046649887-project-member] Enqueued Resource ID: 3507e503-4abd-47ec-8347-82fc9e691881 with Priority: HIGHEST for action security_group_members [ 1232.515522] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3507e503-4abd-47ec-8347-82fc9e691881 with Priority: HIGHEST for action security_group_members [ 1232.515844] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-3507e503-4abd-47ec-8347-82fc9e691881 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.515979] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.516078] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.516724] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.516724] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.516724] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.516976] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.517783] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.517783] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.517783] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3507e503-4abd-47ec-8347-82fc9e691881',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.837330] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 in Status: SUCCESS [ 1232.837582] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.837925] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.838084] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.838176] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('81234d09-eeda-4e4f-bbe7-9aa250a3b427',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.019299] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.019469] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.019543] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.019772] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.019868] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.020085] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.020200] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.020264] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.020405] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.020482] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.020570] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3507e503-4abd-47ec-8347-82fc9e691881 is going to be updated. [ 1233.049708] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.049708] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.049940] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.049986] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.050165] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.059730] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3507e503-4abd-47ec-8347-82fc9e691881 in Status: IN_PROGRESS for 2s [ 1233.207061] env[70392]: INFO networking_nsxv3.common.synchronization [req-ffb25bab-7431-4acf-a5ae-7cd9dd35fd71 req-44350931-498b-4ef9-9157-06c840336e8f tempest-ServersTestJSON-507292717 tempest-ServersTestJSON-507292717-project-member] Enqueued Resource ID: 19062702-bd29-4477-a732-5169f347b4da with Priority: HIGHEST for action security_group_members [ 1233.209358] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19062702-bd29-4477-a732-5169f347b4da with Priority: HIGHEST for action security_group_members [ 1233.209358] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-19062702-bd29-4477-a732-5169f347b4da taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.209358] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.209358] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.209358] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.209358] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.209358] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.209358] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.209358] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.209358] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.209358] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.340780] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-81234d09-eeda-4e4f-bbe7-9aa250a3b427 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.340922] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.341022] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.341263] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.341437] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.341546] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.341885] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.341885] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.341885] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.342085] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.342085] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('81234d09-eeda-4e4f-bbe7-9aa250a3b427',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.711764] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.848024] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-81234d09-eeda-4e4f-bbe7-9aa250a3b427 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.848024] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.848024] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.848024] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.848024] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.848024] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.848024] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.848024] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.848024] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.848024] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.848024] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-81234d09-eeda-4e4f-bbe7-9aa250a3b427 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.848024] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.848024] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.848024] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.848024] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.848024] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.848726] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.848726] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.848726] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.848726] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.848726] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('81234d09-eeda-4e4f-bbe7-9aa250a3b427',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.994382] env[70392]: INFO networking_nsxv3.common.synchronization [req-a060c904-a5c0-4086-b984-924c8a7ddda2 req-474eae5c-5ec2-4f68-ad01-1e61d9b3b142 tempest-DeleteServersTestJSON-1676313022 tempest-DeleteServersTestJSON-1676313022-project-member] Enqueued Resource ID: ce79170a-31ce-429e-8e08-a911557872f4 with Priority: HIGHEST for action security_group_members [ 1233.994877] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce79170a-31ce-429e-8e08-a911557872f4 with Priority: HIGHEST for action security_group_members [ 1233.995230] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce79170a-31ce-429e-8e08-a911557872f4 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.995396] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.995480] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.995728] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.995905] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.996093] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.996093] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.996230] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.996314] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.996404] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce79170a-31ce-429e-8e08-a911557872f4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.214085] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.349892] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 81234d09-eeda-4e4f-bbe7-9aa250a3b427: rpc.has_security_group_logging(os_id): False [ 1234.368388] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.368586] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.368632] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.368870] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.368973] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.369197] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.369298] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.369363] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.369528] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.369617] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.369810] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.369914] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.369976] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.370146] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.370220] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.370407] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.370499] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.370561] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.370700] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.370774] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.370858] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 is going to be updated. [ 1234.431243] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.431243] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.431243] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.431505] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.431505] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.450697] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 in Status: IN_PROGRESS for 2s [ 1234.500555] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.500769] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.500862] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.501156] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.501473] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.501517] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.501630] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.501700] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.501912] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.502009] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.502105] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce79170a-31ce-429e-8e08-a911557872f4 is going to be updated. [ 1234.553533] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.553793] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.553793] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.554066] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.554371] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.573611] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce79170a-31ce-429e-8e08-a911557872f4 in Status: IN_PROGRESS for 2s [ 1234.719922] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.719922] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.719922] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.719922] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.719922] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.719922] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19062702-bd29-4477-a732-5169f347b4da is going to be updated. [ 1234.768052] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.768052] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.768052] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.768052] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.768052] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.773854] env[70392]: INFO networking_nsxv3.common.synchronization [req-682bdb60-3184-4784-9e5d-84dd784e294b req-9ca7f73d-b902-40cc-9f3c-4dae7cf7c99b tempest-AttachVolumeNegativeTest-772339566 tempest-AttachVolumeNegativeTest-772339566-project-member] Enqueued Resource ID: 2e375ce9-a326-43ce-b62b-e40b371dfd91 with Priority: HIGHEST for action security_group_members [ 1234.774124] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e375ce9-a326-43ce-b62b-e40b371dfd91 with Priority: HIGHEST for action security_group_members [ 1234.774448] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e375ce9-a326-43ce-b62b-e40b371dfd91 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.774570] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e375ce9-a326-43ce-b62b-e40b371dfd91" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.774635] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e375ce9-a326-43ce-b62b-e40b371dfd91" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.774955] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e375ce9-a326-43ce-b62b-e40b371dfd91" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.779222] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.779344] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.779412] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.779598] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.779685] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.779782] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e375ce9-a326-43ce-b62b-e40b371dfd91',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.781586] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19062702-bd29-4477-a732-5169f347b4da in Status: IN_PROGRESS for 2s [ 1234.924962] env[70392]: INFO networking_nsxv3.common.synchronization [req-947b6d91-c58d-455c-9db3-1a66b27ca1b5 req-6f563e4e-46fc-4462-97f9-bfc03df26852 tempest-ServersTestMultiNic-1661297721 tempest-ServersTestMultiNic-1661297721-project-member] Enqueued Resource ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 with Priority: HIGHEST for action security_group_members [ 1234.930026] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 with Priority: HIGHEST for action security_group_members [ 1234.930026] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-81234d09-eeda-4e4f-bbe7-9aa250a3b427 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.930026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.930026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.930026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.930026] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.930026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.930026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.930026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.930026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.930026] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('81234d09-eeda-4e4f-bbe7-9aa250a3b427',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.070729] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3507e503-4abd-47ec-8347-82fc9e691881 in Status: SUCCESS [ 1235.070729] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3507e503-4abd-47ec-8347-82fc9e691881 deletion is rescheduled due to dependency. [ 1235.070729] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.093264] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-483 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.093264] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-483" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.093264] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-483" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.093264] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-483" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.093264] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.094074] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.096666] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.096666] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.096666] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.096666] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1235.096666] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1235.096666] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1235.096666] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1235.096666] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1235.096666] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1235.096666] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1235.118082] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1235.118305] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1235.118468] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1235.118652] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-483" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.119612] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-59a8cead-d4c3-46d7-a853-d51c48dbb2e1 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.119612] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-59a8cead-d4c3-46d7-a853-d51c48dbb2e1" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.119612] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-59a8cead-d4c3-46d7-a853-d51c48dbb2e1" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.119797] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-59a8cead-d4c3-46d7-a853-d51c48dbb2e1" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.119797] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('59a8cead-d4c3-46d7-a853-d51c48dbb2e1',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.202149] env[70392]: INFO networking_nsxv3.common.synchronization [req-947b6d91-c58d-455c-9db3-1a66b27ca1b5 req-a0667365-efb8-4b67-9dc7-f1a2edd5998e tempest-ServersTestMultiNic-1661297721 tempest-ServersTestMultiNic-1661297721-project-member] Enqueued Resource ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 with Priority: HIGHEST for action security_group_members [ 1235.203389] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 with Priority: HIGHEST for action security_group_members [ 1235.203389] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-81234d09-eeda-4e4f-bbe7-9aa250a3b427 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.203389] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.283035] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.283035] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.283035] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.283233] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.283266] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.283476] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.283569] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.284043] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.284043] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.284043] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.284043] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e375ce9-a326-43ce-b62b-e40b371dfd91 already deleted. [ 1235.284204] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e375ce9-a326-43ce-b62b-e40b371dfd91" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.433331] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('81234d09-eeda-4e4f-bbe7-9aa250a3b427',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.629083] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.629083] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.629083] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.629266] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.629993] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.629993] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 59a8cead-d4c3-46d7-a853-d51c48dbb2e1 not found, creating... [ 1235.629993] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.629993] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.630409] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.630409] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.630524] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.631170] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.631170] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.631170] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.631353] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.631457] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.631624] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 59a8cead-d4c3-46d7-a853-d51c48dbb2e1 is going to be created. [ 1235.653018] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.653302] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.653462] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.653761] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.654038] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.654297] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-59a8cead-d4c3-46d7-a853-d51c48dbb2e1" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.937409] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('81234d09-eeda-4e4f-bbe7-9aa250a3b427',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.376694] env[70392]: INFO networking_nsxv3.common.synchronization [req-682bdb60-3184-4784-9e5d-84dd784e294b req-cd522507-1355-439d-8197-daa32db0d4f7 service nova] Enqueued Resource ID: 2e375ce9-a326-43ce-b62b-e40b371dfd91 with Priority: HIGHEST for action security_group_rules [ 1236.376997] env[70392]: INFO networking_nsxv3.common.synchronization [req-682bdb60-3184-4784-9e5d-84dd784e294b req-cd522507-1355-439d-8197-daa32db0d4f7 service nova] Enqueued Resource ID: 2e375ce9-a326-43ce-b62b-e40b371dfd91 with Priority: HIGHEST for action security_group_members [ 1236.377243] env[70392]: INFO networking_nsxv3.common.synchronization [req-682bdb60-3184-4784-9e5d-84dd784e294b req-cd522507-1355-439d-8197-daa32db0d4f7 service nova] Enqueued Resource ID: 59a8cead-d4c3-46d7-a853-d51c48dbb2e1 with Priority: HIGHEST for action port [ 1236.378086] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e375ce9-a326-43ce-b62b-e40b371dfd91 with Priority: HIGHEST for action security_group_rules [ 1236.378383] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e375ce9-a326-43ce-b62b-e40b371dfd91 with Priority: HIGHEST for action security_group_members [ 1236.378514] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59a8cead-d4c3-46d7-a853-d51c48dbb2e1 with Priority: HIGHEST for action port [ 1236.378862] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2e375ce9-a326-43ce-b62b-e40b371dfd91 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.379048] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2e375ce9-a326-43ce-b62b-e40b371dfd91" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.379148] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2e375ce9-a326-43ce-b62b-e40b371dfd91" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.379374] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2e375ce9-a326-43ce-b62b-e40b371dfd91" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.379464] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2e375ce9-a326-43ce-b62b-e40b371dfd91',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.380368] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e375ce9-a326-43ce-b62b-e40b371dfd91 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.380489] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e375ce9-a326-43ce-b62b-e40b371dfd91" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.380557] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e375ce9-a326-43ce-b62b-e40b371dfd91" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.380725] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e375ce9-a326-43ce-b62b-e40b371dfd91" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.380943] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.381140] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.381140] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.381202] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.381296] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.381394] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e375ce9-a326-43ce-b62b-e40b371dfd91',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.382352] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-59a8cead-d4c3-46d7-a853-d51c48dbb2e1 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.382352] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-59a8cead-d4c3-46d7-a853-d51c48dbb2e1" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.382352] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-59a8cead-d4c3-46d7-a853-d51c48dbb2e1" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.382485] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-59a8cead-d4c3-46d7-a853-d51c48dbb2e1" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.382562] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('59a8cead-d4c3-46d7-a853-d51c48dbb2e1',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.438255] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.438430] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.438473] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.438686] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.438798] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.439013] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 is going to be updated. [ 1236.469882] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 in Status: SUCCESS [ 1236.470173] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.472724] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.472881] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.472948] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.473171] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.473306] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.483998] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 in Status: IN_PROGRESS for 2s [ 1236.517060] env[70392]: INFO networking_nsxv3.common.synchronization [req-b9b8c244-63cb-43ed-ae37-e49b273b7dfb req-3ea7ec35-1f58-47b3-8344-8c9f0f40e040 tempest-ServersNegativeTestJSON-1387658603 tempest-ServersNegativeTestJSON-1387658603-project-member] Enqueued Resource ID: c3e59ae3-629d-4146-9bee-ef9808a03841 with Priority: HIGHEST for action security_group_members [ 1236.517619] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3e59ae3-629d-4146-9bee-ef9808a03841 with Priority: HIGHEST for action security_group_members [ 1236.517996] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3e59ae3-629d-4146-9bee-ef9808a03841 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.518427] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.518427] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.518427] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.518543] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.518929] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.518929] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.518929] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.519126] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.519187] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c3e59ae3-629d-4146-9bee-ef9808a03841',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.585521] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce79170a-31ce-429e-8e08-a911557872f4 in Status: SUCCESS [ 1236.585521] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce79170a-31ce-429e-8e08-a911557872f4 deletion is rescheduled due to dependency. [ 1236.585745] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.792644] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19062702-bd29-4477-a732-5169f347b4da in Status: SUCCESS [ 1236.792644] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.885018] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e375ce9-a326-43ce-b62b-e40b371dfd91 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.885018] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e375ce9-a326-43ce-b62b-e40b371dfd91" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.885821] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2e375ce9-a326-43ce-b62b-e40b371dfd91',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.886974] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 59a8cead-d4c3-46d7-a853-d51c48dbb2e1 with status ACTIVE [ 1236.887264] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.887659] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.889993] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.890244] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.890340] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.890550] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.890658] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.890722] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.890892] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.890970] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.893030] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.893030] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.893030] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.893030] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.893030] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.893030] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 59a8cead-d4c3-46d7-a853-d51c48dbb2e1 is going to be updated. [ 1236.914569] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.914761] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.914761] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.914972] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.915130] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.915287] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-59a8cead-d4c3-46d7-a853-d51c48dbb2e1" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.023084] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.023430] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.023430] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.023517] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.023634] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.023892] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.024142] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.024142] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.024249] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.024292] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.024380] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3e59ae3-629d-4146-9bee-ef9808a03841 is going to be updated. [ 1237.067191] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.067428] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.067428] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.067675] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.067812] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.076802] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3e59ae3-629d-4146-9bee-ef9808a03841 in Status: IN_PROGRESS for 2s [ 1237.394406] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2e375ce9-a326-43ce-b62b-e40b371dfd91',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.467594] env[70392]: INFO networking_nsxv3.common.synchronization [None req-af0f2691-db56-4afc-a753-df6b1d6485e0 None None] Enqueued Resource ID: ad985256-6e96-4257-a0a9-f7ec0bd2ae48 with Priority: HIGHEST for action port [ 1237.467845] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad985256-6e96-4257-a0a9-f7ec0bd2ae48 with Priority: HIGHEST for action port [ 1237.468511] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-ad985256-6e96-4257-a0a9-f7ec0bd2ae48 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.468638] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ad985256-6e96-4257-a0a9-f7ec0bd2ae48" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.468707] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ad985256-6e96-4257-a0a9-f7ec0bd2ae48" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.468966] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ad985256-6e96-4257-a0a9-f7ec0bd2ae48" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.469134] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad985256-6e96-4257-a0a9-f7ec0bd2ae48',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.897027] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.897138] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.897138] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.897657] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.897657] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.897657] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e375ce9-a326-43ce-b62b-e40b371dfd91 is going to be created. [ 1237.924174] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.924326] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.924399] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.924609] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.924773] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.938641] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e375ce9-a326-43ce-b62b-e40b371dfd91 in Status: UNINITIALIZED for 2s [ 1237.971135] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ad985256-6e96-4257-a0a9-f7ec0bd2ae48 [ 1237.971384] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.971527] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.971600] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.971817] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.971913] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.972017] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ad985256-6e96-4257-a0a9-f7ec0bd2ae48 already deleted. [ 1237.972584] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ad985256-6e96-4257-a0a9-f7ec0bd2ae48" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.494634] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 in Status: SUCCESS [ 1238.495092] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.495092] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.495374] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.495598] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.495870] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.495870] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.495992] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.496077] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.496184] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('81234d09-eeda-4e4f-bbe7-9aa250a3b427',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.999199] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.999352] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.999428] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.999644] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.999737] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.999962] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.000081] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.000165] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.000333] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.000412] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.000503] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 is going to be updated. [ 1239.026112] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.026292] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.026368] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.026574] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.026740] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.040911] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 in Status: IN_PROGRESS for 2s [ 1239.088028] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3e59ae3-629d-4146-9bee-ef9808a03841 in Status: SUCCESS [ 1239.088028] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3e59ae3-629d-4146-9bee-ef9808a03841 deletion is rescheduled due to dependency. [ 1239.088028] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.910618] env[70392]: INFO networking_nsxv3.common.synchronization [None req-63715754-07d0-479f-a389-96f393dffdbd None None] Enqueued Resource ID: c2474796-5f03-4c49-853a-0af4b158f389 with Priority: HIGHEST for action port [ 1239.910922] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2474796-5f03-4c49-853a-0af4b158f389 with Priority: HIGHEST for action port [ 1239.911220] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-c2474796-5f03-4c49-853a-0af4b158f389 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.911353] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c2474796-5f03-4c49-853a-0af4b158f389" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.911422] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c2474796-5f03-4c49-853a-0af4b158f389" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.911679] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c2474796-5f03-4c49-853a-0af4b158f389" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.911777] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2474796-5f03-4c49-853a-0af4b158f389',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.951585] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e375ce9-a326-43ce-b62b-e40b371dfd91 in Status: SUCCESS [ 1239.951825] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e375ce9-a326-43ce-b62b-e40b371dfd91" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.952010] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e375ce9-a326-43ce-b62b-e40b371dfd91" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.952242] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e375ce9-a326-43ce-b62b-e40b371dfd91" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.952446] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.952559] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.952631] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.952797] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.952890] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.952990] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e375ce9-a326-43ce-b62b-e40b371dfd91" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.953097] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2e375ce9-a326-43ce-b62b-e40b371dfd91',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.415181] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c2474796-5f03-4c49-853a-0af4b158f389 [ 1240.415181] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.415181] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.415181] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.415181] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.415181] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.415755] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c2474796-5f03-4c49-853a-0af4b158f389 already deleted. [ 1240.415755] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c2474796-5f03-4c49-853a-0af4b158f389" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.455706] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2e375ce9-a326-43ce-b62b-e40b371dfd91',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.959677] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2e375ce9-a326-43ce-b62b-e40b371dfd91: rpc.has_security_group_logging(os_id): False [ 1240.990207] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.991501] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.991501] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.991501] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.991501] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.991501] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.991501] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.991501] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.991883] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.991883] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.991883] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2e375ce9-a326-43ce-b62b-e40b371dfd91 is going to be created. [ 1241.052088] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 in Status: SUCCESS [ 1241.052370] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 deletion is rescheduled due to dependency. [ 1241.052661] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.076505] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.076505] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.076505] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.076663] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.076852] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.096618] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2e375ce9-a326-43ce-b62b-e40b371dfd91 in Status: IN_PROGRESS for 2s [ 1242.229238] env[70392]: INFO networking_nsxv3.common.synchronization [req-d05a4bea-0b92-4ac3-bec6-57f18f99a296 req-591ab8de-aa41-4fc0-b04a-b1c5e3842734 tempest-ServersTestJSON-507292717 tempest-ServersTestJSON-507292717-project-member] Enqueued Resource ID: 19062702-bd29-4477-a732-5169f347b4da with Priority: HIGHEST for action security_group_members [ 1242.231082] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19062702-bd29-4477-a732-5169f347b4da with Priority: HIGHEST for action security_group_members [ 1242.231082] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-19062702-bd29-4477-a732-5169f347b4da taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.231082] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.231082] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.231082] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.231082] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.231082] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.231082] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.231082] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.231082] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.231082] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.732896] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.112090] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2e375ce9-a326-43ce-b62b-e40b371dfd91 in Status: SUCCESS [ 1243.112090] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2e375ce9-a326-43ce-b62b-e40b371dfd91" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.235727] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.741601] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.741954] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.741954] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.742076] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.742153] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.742262] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19062702-bd29-4477-a732-5169f347b4da is going to be updated. [ 1243.784274] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.784456] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.784536] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.784702] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.784850] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.796352] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19062702-bd29-4477-a732-5169f347b4da in Status: IN_PROGRESS for 2s [ 1244.271685] env[70392]: INFO networking_nsxv3.common.synchronization [req-d8641377-becd-49d5-afbd-0a4ed80c7db1 req-a9bb5cbe-a63c-47eb-a1d7-4a4321cc5b98 tempest-ServerAddressesTestJSON-338193336 tempest-ServerAddressesTestJSON-338193336-project-member] Enqueued Resource ID: 7134cdd3-ca0e-4544-bb16-183af6eac784 with Priority: HIGHEST for action security_group_members [ 1244.272280] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7134cdd3-ca0e-4544-bb16-183af6eac784 with Priority: HIGHEST for action security_group_members [ 1244.272715] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-7134cdd3-ca0e-4544-bb16-183af6eac784 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.272715] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7134cdd3-ca0e-4544-bb16-183af6eac784" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.272825] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7134cdd3-ca0e-4544-bb16-183af6eac784" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.273613] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7134cdd3-ca0e-4544-bb16-183af6eac784" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.273613] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.273613] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.273613] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.273613] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.273613] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.273941] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7134cdd3-ca0e-4544-bb16-183af6eac784',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.498108] env[70392]: INFO networking_nsxv3.common.synchronization [None req-7748cf82-de14-4b9a-b4aa-5b9521659603 None None] Enqueued Resource ID: 50557f49-996f-478a-9a7d-beabd18cf13b with Priority: HIGHEST for action port [ 1244.498684] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50557f49-996f-478a-9a7d-beabd18cf13b with Priority: HIGHEST for action port [ 1244.499021] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-50557f49-996f-478a-9a7d-beabd18cf13b taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.499149] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-50557f49-996f-478a-9a7d-beabd18cf13b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.499220] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-50557f49-996f-478a-9a7d-beabd18cf13b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.499471] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-50557f49-996f-478a-9a7d-beabd18cf13b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.499586] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('50557f49-996f-478a-9a7d-beabd18cf13b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.694205] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-849 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.694418] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-849" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.694550] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-849" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.694885] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-849" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.695492] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.695732] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.695915] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.696208] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.696468] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.696734] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1244.696930] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1244.697108] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1244.697278] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1244.697446] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1244.697606] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1244.697791] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1244.717759] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1244.717971] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1244.718369] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1244.718369] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-849" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.718899] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-704f5fd8-5a26-4f16-80ca-8efcc160fdfa taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.719036] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-704f5fd8-5a26-4f16-80ca-8efcc160fdfa" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.719174] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-704f5fd8-5a26-4f16-80ca-8efcc160fdfa" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.720022] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-704f5fd8-5a26-4f16-80ca-8efcc160fdfa" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.720443] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('704f5fd8-5a26-4f16-80ca-8efcc160fdfa',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.776017] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.776199] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.776950] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.776950] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.776950] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.776950] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.776950] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.776950] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.777249] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.777249] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.777249] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7134cdd3-ca0e-4544-bb16-183af6eac784 already deleted. [ 1244.777332] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7134cdd3-ca0e-4544-bb16-183af6eac784" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.006588] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 50557f49-996f-478a-9a7d-beabd18cf13b [ 1245.006588] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.006588] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.006588] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.006588] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.006588] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.006588] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:50557f49-996f-478a-9a7d-beabd18cf13b already deleted. [ 1245.006588] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-50557f49-996f-478a-9a7d-beabd18cf13b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.223181] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.223496] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.223632] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.223925] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.224098] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.224261] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 704f5fd8-5a26-4f16-80ca-8efcc160fdfa not found, creating... [ 1245.224527] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.224771] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.224819] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.225022] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.225165] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.225448] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.225603] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.225724] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.225935] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.226601] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.226826] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 704f5fd8-5a26-4f16-80ca-8efcc160fdfa is going to be created. [ 1245.247615] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.247615] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.247769] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.248037] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.248605] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.248605] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-704f5fd8-5a26-4f16-80ca-8efcc160fdfa" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.810778] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19062702-bd29-4477-a732-5169f347b4da in Status: SUCCESS [ 1245.811055] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.025742] env[70392]: INFO networking_nsxv3.common.synchronization [req-d8641377-becd-49d5-afbd-0a4ed80c7db1 req-ff63cd88-2da5-450c-89fb-ee057708fe1f service nova] Enqueued Resource ID: 7134cdd3-ca0e-4544-bb16-183af6eac784 with Priority: HIGHEST for action security_group_rules [ 1246.026228] env[70392]: INFO networking_nsxv3.common.synchronization [req-d8641377-becd-49d5-afbd-0a4ed80c7db1 req-ff63cd88-2da5-450c-89fb-ee057708fe1f service nova] Enqueued Resource ID: 7134cdd3-ca0e-4544-bb16-183af6eac784 with Priority: HIGHEST for action security_group_members [ 1246.026374] env[70392]: INFO networking_nsxv3.common.synchronization [req-d8641377-becd-49d5-afbd-0a4ed80c7db1 req-ff63cd88-2da5-450c-89fb-ee057708fe1f service nova] Enqueued Resource ID: 704f5fd8-5a26-4f16-80ca-8efcc160fdfa with Priority: HIGHEST for action port [ 1246.026976] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7134cdd3-ca0e-4544-bb16-183af6eac784 with Priority: HIGHEST for action security_group_rules [ 1246.029266] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7134cdd3-ca0e-4544-bb16-183af6eac784 with Priority: HIGHEST for action security_group_members [ 1246.029467] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 704f5fd8-5a26-4f16-80ca-8efcc160fdfa with Priority: HIGHEST for action port [ 1246.030262] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7134cdd3-ca0e-4544-bb16-183af6eac784 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.030415] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7134cdd3-ca0e-4544-bb16-183af6eac784" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.030487] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7134cdd3-ca0e-4544-bb16-183af6eac784" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.030781] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7134cdd3-ca0e-4544-bb16-183af6eac784" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.030891] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7134cdd3-ca0e-4544-bb16-183af6eac784',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.031952] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-7134cdd3-ca0e-4544-bb16-183af6eac784 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.032114] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7134cdd3-ca0e-4544-bb16-183af6eac784" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.032306] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7134cdd3-ca0e-4544-bb16-183af6eac784" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.032422] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7134cdd3-ca0e-4544-bb16-183af6eac784" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.032590] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.032716] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.032778] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.032951] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.033258] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.033335] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7134cdd3-ca0e-4544-bb16-183af6eac784',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.034519] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-704f5fd8-5a26-4f16-80ca-8efcc160fdfa taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.038274] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-704f5fd8-5a26-4f16-80ca-8efcc160fdfa" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.038274] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-704f5fd8-5a26-4f16-80ca-8efcc160fdfa" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.038274] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-704f5fd8-5a26-4f16-80ca-8efcc160fdfa" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.038274] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('704f5fd8-5a26-4f16-80ca-8efcc160fdfa',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.510211] env[70392]: INFO networking_nsxv3.common.synchronization [req-ea0258c9-964d-4510-977e-f5f4bb312ad3 req-f6182db6-9afe-4642-94ab-8bd571edfb57 tempest-ServerActionsTestOtherA-1411478130 tempest-ServerActionsTestOtherA-1411478130-project-member] Enqueued Resource ID: f5251c5e-578a-48aa-8195-e1dc88834ad8 with Priority: HIGHEST for action security_group_members [ 1246.510516] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5251c5e-578a-48aa-8195-e1dc88834ad8 with Priority: HIGHEST for action security_group_members [ 1246.510810] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5251c5e-578a-48aa-8195-e1dc88834ad8 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.510927] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5251c5e-578a-48aa-8195-e1dc88834ad8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.511036] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5251c5e-578a-48aa-8195-e1dc88834ad8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.511197] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5251c5e-578a-48aa-8195-e1dc88834ad8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.511352] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.511448] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.511508] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.511667] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.511734] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.511824] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5251c5e-578a-48aa-8195-e1dc88834ad8',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.536577] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7134cdd3-ca0e-4544-bb16-183af6eac784',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.537706] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-7134cdd3-ca0e-4544-bb16-183af6eac784 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.537706] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7134cdd3-ca0e-4544-bb16-183af6eac784" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.541424] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 704f5fd8-5a26-4f16-80ca-8efcc160fdfa with status ACTIVE [ 1246.542109] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.542420] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.542420] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.542600] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.542720] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.544998] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.545383] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.545383] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.545383] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.545504] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.545649] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.547021] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.547021] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.547021] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.547021] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.547021] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 704f5fd8-5a26-4f16-80ca-8efcc160fdfa is going to be updated. [ 1246.573704] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.574455] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.574455] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.574455] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.574455] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.574455] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-704f5fd8-5a26-4f16-80ca-8efcc160fdfa" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.598157] env[70392]: INFO networking_nsxv3.common.synchronization [None req-09d1bc52-2d84-431d-a902-364c5e99c3ab None None] Enqueued Resource ID: 2756a52b-c276-4076-a8ba-4d9137686516 with Priority: HIGHEST for action port [ 1246.598157] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2756a52b-c276-4076-a8ba-4d9137686516 with Priority: HIGHEST for action port [ 1246.598334] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-2756a52b-c276-4076-a8ba-4d9137686516 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.598459] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2756a52b-c276-4076-a8ba-4d9137686516" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.598624] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2756a52b-c276-4076-a8ba-4d9137686516" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.598789] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2756a52b-c276-4076-a8ba-4d9137686516" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.598876] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2756a52b-c276-4076-a8ba-4d9137686516',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.001109] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-844 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.001446] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-844" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.001497] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-844" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.001766] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-844" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.004103] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.004356] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.004496] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.004750] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.004908] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.005158] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1247.005282] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1247.005396] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1247.005508] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1247.005623] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1247.005735] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1247.005892] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1247.014399] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.016330] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.016330] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.016330] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.016330] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.016330] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.016330] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.016330] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.016330] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.016330] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.016330] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5251c5e-578a-48aa-8195-e1dc88834ad8 is going to be deleted. [ 1247.040613] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7134cdd3-ca0e-4544-bb16-183af6eac784',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.051228] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1247.051413] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.045 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1247.051672] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1247.051770] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-844" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.052569] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-cc107d10-ea7f-41b3-8095-b7673d18e2b3 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.052569] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-cc107d10-ea7f-41b3-8095-b7673d18e2b3" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.052569] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-cc107d10-ea7f-41b3-8095-b7673d18e2b3" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.052789] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-cc107d10-ea7f-41b3-8095-b7673d18e2b3" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.053555] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc107d10-ea7f-41b3-8095-b7673d18e2b3',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.060148] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.060297] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.060370] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.060577] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.060669] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.060768] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5251c5e-578a-48aa-8195-e1dc88834ad8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.101228] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2756a52b-c276-4076-a8ba-4d9137686516 [ 1247.101517] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.101744] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.101744] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.101918] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.102012] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.102137] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2756a52b-c276-4076-a8ba-4d9137686516 already deleted. [ 1247.102412] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2756a52b-c276-4076-a8ba-4d9137686516" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.542646] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.542853] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.542966] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.543191] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.543289] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.543395] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7134cdd3-ca0e-4544-bb16-183af6eac784 is going to be created. [ 1247.555999] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.556267] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.556495] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.556873] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.557081] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.557332] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port cc107d10-ea7f-41b3-8095-b7673d18e2b3 not found, creating... [ 1247.557610] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.557799] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.557892] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.558203] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.558397] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.558634] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.558791] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.558909] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.559162] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.559306] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.559450] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: cc107d10-ea7f-41b3-8095-b7673d18e2b3 is going to be created. [ 1247.569216] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.569415] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.569415] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.570676] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.570676] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.579337] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7134cdd3-ca0e-4544-bb16-183af6eac784 in Status: UNINITIALIZED for 2s [ 1247.582415] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.582763] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.582898] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.583196] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.583426] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.583650] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-cc107d10-ea7f-41b3-8095-b7673d18e2b3" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.176297] env[70392]: INFO networking_nsxv3.common.synchronization [None req-0d7fa12a-da9b-44e0-9ee2-6bdc096efaf5 None None] Enqueued Resource ID: b1c20390-b23f-491d-87ca-fb5e635ee637 with Priority: HIGHEST for action port [ 1248.178529] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1c20390-b23f-491d-87ca-fb5e635ee637 with Priority: HIGHEST for action port [ 1248.178529] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-b1c20390-b23f-491d-87ca-fb5e635ee637 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.178529] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b1c20390-b23f-491d-87ca-fb5e635ee637" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.178529] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b1c20390-b23f-491d-87ca-fb5e635ee637" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.178529] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b1c20390-b23f-491d-87ca-fb5e635ee637" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.178529] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1c20390-b23f-491d-87ca-fb5e635ee637',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.592109] env[70392]: INFO networking_nsxv3.common.synchronization [req-ea0258c9-964d-4510-977e-f5f4bb312ad3 req-afffc848-2679-4b24-84e4-3c0b228d26bc service nova] Enqueued Resource ID: f5251c5e-578a-48aa-8195-e1dc88834ad8 with Priority: HIGHEST for action security_group_rules [ 1248.592332] env[70392]: INFO networking_nsxv3.common.synchronization [req-ea0258c9-964d-4510-977e-f5f4bb312ad3 req-afffc848-2679-4b24-84e4-3c0b228d26bc service nova] Enqueued Resource ID: f5251c5e-578a-48aa-8195-e1dc88834ad8 with Priority: HIGHEST for action security_group_members [ 1248.592557] env[70392]: INFO networking_nsxv3.common.synchronization [req-ea0258c9-964d-4510-977e-f5f4bb312ad3 req-afffc848-2679-4b24-84e4-3c0b228d26bc service nova] Enqueued Resource ID: cc107d10-ea7f-41b3-8095-b7673d18e2b3 with Priority: HIGHEST for action port [ 1248.593180] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5251c5e-578a-48aa-8195-e1dc88834ad8 with Priority: HIGHEST for action security_group_rules [ 1248.593331] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5251c5e-578a-48aa-8195-e1dc88834ad8 with Priority: HIGHEST for action security_group_members [ 1248.594247] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc107d10-ea7f-41b3-8095-b7673d18e2b3 with Priority: HIGHEST for action port [ 1248.594330] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f5251c5e-578a-48aa-8195-e1dc88834ad8 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.594472] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f5251c5e-578a-48aa-8195-e1dc88834ad8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.594539] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f5251c5e-578a-48aa-8195-e1dc88834ad8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.594749] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f5251c5e-578a-48aa-8195-e1dc88834ad8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.594827] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f5251c5e-578a-48aa-8195-e1dc88834ad8',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.595733] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5251c5e-578a-48aa-8195-e1dc88834ad8 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.595895] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5251c5e-578a-48aa-8195-e1dc88834ad8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.595930] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5251c5e-578a-48aa-8195-e1dc88834ad8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.596894] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5251c5e-578a-48aa-8195-e1dc88834ad8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.596894] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.597839] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.597839] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.597839] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.597839] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.597839] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5251c5e-578a-48aa-8195-e1dc88834ad8',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.599351] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-cc107d10-ea7f-41b3-8095-b7673d18e2b3 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.599467] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cc107d10-ea7f-41b3-8095-b7673d18e2b3" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.599536] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cc107d10-ea7f-41b3-8095-b7673d18e2b3" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.599706] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cc107d10-ea7f-41b3-8095-b7673d18e2b3" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.599788] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc107d10-ea7f-41b3-8095-b7673d18e2b3',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.684544] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b1c20390-b23f-491d-87ca-fb5e635ee637 [ 1248.685344] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.685344] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.685344] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.685344] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.685344] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.685585] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b1c20390-b23f-491d-87ca-fb5e635ee637 already deleted. [ 1248.685585] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b1c20390-b23f-491d-87ca-fb5e635ee637" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.105061] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cc107d10-ea7f-41b3-8095-b7673d18e2b3 with status ACTIVE [ 1249.105061] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.105061] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.105061] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.105061] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.105061] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.105061] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.105061] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.105061] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.105061] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.105061] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.105061] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.105061] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.105061] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.105061] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.105061] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.105728] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cc107d10-ea7f-41b3-8095-b7673d18e2b3 is going to be updated. [ 1249.106548] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f5251c5e-578a-48aa-8195-e1dc88834ad8',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.107923] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5251c5e-578a-48aa-8195-e1dc88834ad8 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.108059] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5251c5e-578a-48aa-8195-e1dc88834ad8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.130191] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.130191] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.130191] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.130466] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.130466] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.130658] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cc107d10-ea7f-41b3-8095-b7673d18e2b3" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.590721] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7134cdd3-ca0e-4544-bb16-183af6eac784 in Status: SUCCESS [ 1249.591049] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7134cdd3-ca0e-4544-bb16-183af6eac784" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.591300] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7134cdd3-ca0e-4544-bb16-183af6eac784" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.591627] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7134cdd3-ca0e-4544-bb16-183af6eac784" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.591832] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.591972] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.592054] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.592254] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.592360] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.592453] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7134cdd3-ca0e-4544-bb16-183af6eac784" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.592546] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7134cdd3-ca0e-4544-bb16-183af6eac784',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.610839] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f5251c5e-578a-48aa-8195-e1dc88834ad8',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.094678] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-7134cdd3-ca0e-4544-bb16-183af6eac784 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.094832] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7134cdd3-ca0e-4544-bb16-183af6eac784" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.094907] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7134cdd3-ca0e-4544-bb16-183af6eac784" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.095149] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7134cdd3-ca0e-4544-bb16-183af6eac784" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.095316] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.095416] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.095482] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.095987] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.095987] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.095987] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7134cdd3-ca0e-4544-bb16-183af6eac784" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.095987] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-7134cdd3-ca0e-4544-bb16-183af6eac784 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.096198] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7134cdd3-ca0e-4544-bb16-183af6eac784" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.096198] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7134cdd3-ca0e-4544-bb16-183af6eac784" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.096264] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7134cdd3-ca0e-4544-bb16-183af6eac784" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.096349] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.096438] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.096496] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.096629] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.096702] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.096781] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7134cdd3-ca0e-4544-bb16-183af6eac784" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.096866] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7134cdd3-ca0e-4544-bb16-183af6eac784',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.113505] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.113637] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.113706] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.113889] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.113971] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.114084] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5251c5e-578a-48aa-8195-e1dc88834ad8 is going to be created. [ 1250.137115] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.137267] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.137366] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.137537] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.137690] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.147704] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5251c5e-578a-48aa-8195-e1dc88834ad8 in Status: UNINITIALIZED for 2s [ 1250.391854] env[70392]: INFO networking_nsxv3.common.synchronization [None req-c7be1dcc-38f5-4217-ada8-74fe561d0678 None None] Enqueued Resource ID: d095b423-475b-4b0d-aa5f-dae3a9698bc7 with Priority: HIGHEST for action port [ 1250.392632] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d095b423-475b-4b0d-aa5f-dae3a9698bc7 with Priority: HIGHEST for action port [ 1250.393061] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-d095b423-475b-4b0d-aa5f-dae3a9698bc7 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.393219] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d095b423-475b-4b0d-aa5f-dae3a9698bc7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.393305] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d095b423-475b-4b0d-aa5f-dae3a9698bc7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.393606] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d095b423-475b-4b0d-aa5f-dae3a9698bc7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.393718] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d095b423-475b-4b0d-aa5f-dae3a9698bc7',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.599168] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7134cdd3-ca0e-4544-bb16-183af6eac784: rpc.has_security_group_logging(os_id): False [ 1250.618357] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.618529] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.618569] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.618824] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.618913] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.619134] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.619246] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.619308] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.619468] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.619549] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.619749] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.619843] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.619903] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.620051] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.620126] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.620325] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.620528] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.620528] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.620660] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.620731] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.620817] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7134cdd3-ca0e-4544-bb16-183af6eac784 is going to be created. [ 1250.684349] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.684556] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.684556] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.684753] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.684932] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.697048] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7134cdd3-ca0e-4544-bb16-183af6eac784 in Status: IN_PROGRESS for 2s [ 1250.878065] env[70392]: INFO networking_nsxv3.common.synchronization [req-f81fa9e2-136c-4365-99f8-4a7cdee5e13e req-c50743ff-8211-4efc-bc29-06081add97e4 tempest-ListServersNegativeTestJSON-1390298334 tempest-ListServersNegativeTestJSON-1390298334-project-member] Enqueued Resource ID: e33b6cac-e9e7-4fe8-a87b-2dee2c42645e with Priority: HIGHEST for action security_group_members [ 1250.878685] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e33b6cac-e9e7-4fe8-a87b-2dee2c42645e with Priority: HIGHEST for action security_group_members [ 1250.879013] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.879188] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.880036] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.880036] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.880036] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.880036] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.880036] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.880036] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.880327] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.880327] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e33b6cac-e9e7-4fe8-a87b-2dee2c42645e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.897039] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d095b423-475b-4b0d-aa5f-dae3a9698bc7 [ 1250.897039] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.897039] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.897039] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.897039] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.897039] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.897039] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d095b423-475b-4b0d-aa5f-dae3a9698bc7 already deleted. [ 1250.897039] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d095b423-475b-4b0d-aa5f-dae3a9698bc7" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.176342] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-993 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.176843] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-993" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.177299] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-993" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.177946] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-993" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.178404] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.178755] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.180188] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.180188] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.180188] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.180188] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1251.180188] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1251.180188] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1251.180188] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1251.180188] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1251.180547] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1251.181527] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1251.205494] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1251.205494] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1251.205494] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1251.205494] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-993" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.205494] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-1569a645-b31c-46d6-bf6d-8d945aec0f40 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.205494] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-1569a645-b31c-46d6-bf6d-8d945aec0f40" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.205494] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-1569a645-b31c-46d6-bf6d-8d945aec0f40" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.205849] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-1569a645-b31c-46d6-bf6d-8d945aec0f40" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.205993] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1569a645-b31c-46d6-bf6d-8d945aec0f40',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.383037] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.383037] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.383037] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.383037] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.383037] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.383037] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.383551] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.383551] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.383551] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.383551] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.383772] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e33b6cac-e9e7-4fe8-a87b-2dee2c42645e already deleted. [ 1251.383772] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.708906] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.709376] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.709376] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.709648] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.709800] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.709958] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 1569a645-b31c-46d6-bf6d-8d945aec0f40 not found, creating... [ 1251.710267] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.710438] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.710560] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.710786] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.710928] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.711252] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.711390] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.711511] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.711720] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.712112] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.712306] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 1569a645-b31c-46d6-bf6d-8d945aec0f40 is going to be created. [ 1251.735145] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.735377] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.735508] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.735798] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.736096] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.736348] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-1569a645-b31c-46d6-bf6d-8d945aec0f40" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.158488] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5251c5e-578a-48aa-8195-e1dc88834ad8 in Status: SUCCESS [ 1252.159692] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5251c5e-578a-48aa-8195-e1dc88834ad8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.159692] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5251c5e-578a-48aa-8195-e1dc88834ad8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.159692] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5251c5e-578a-48aa-8195-e1dc88834ad8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.159692] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.159692] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.159692] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.159977] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.159977] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.159977] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5251c5e-578a-48aa-8195-e1dc88834ad8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.160077] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f5251c5e-578a-48aa-8195-e1dc88834ad8',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.434482] env[70392]: INFO networking_nsxv3.common.synchronization [req-f81fa9e2-136c-4365-99f8-4a7cdee5e13e req-7b9a5c37-04c1-4f10-a3c6-bb1c4e5dceb5 service nova] Enqueued Resource ID: e33b6cac-e9e7-4fe8-a87b-2dee2c42645e with Priority: HIGHEST for action security_group_rules [ 1252.434674] env[70392]: INFO networking_nsxv3.common.synchronization [req-f81fa9e2-136c-4365-99f8-4a7cdee5e13e req-7b9a5c37-04c1-4f10-a3c6-bb1c4e5dceb5 service nova] Enqueued Resource ID: e33b6cac-e9e7-4fe8-a87b-2dee2c42645e with Priority: HIGHEST for action security_group_members [ 1252.434818] env[70392]: INFO networking_nsxv3.common.synchronization [req-f81fa9e2-136c-4365-99f8-4a7cdee5e13e req-7b9a5c37-04c1-4f10-a3c6-bb1c4e5dceb5 service nova] Enqueued Resource ID: 1569a645-b31c-46d6-bf6d-8d945aec0f40 with Priority: HIGHEST for action port [ 1252.435341] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e33b6cac-e9e7-4fe8-a87b-2dee2c42645e with Priority: HIGHEST for action security_group_rules [ 1252.435477] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e33b6cac-e9e7-4fe8-a87b-2dee2c42645e with Priority: HIGHEST for action security_group_members [ 1252.435575] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1569a645-b31c-46d6-bf6d-8d945aec0f40 with Priority: HIGHEST for action port [ 1252.435846] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.435987] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.437550] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.437821] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.437910] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e33b6cac-e9e7-4fe8-a87b-2dee2c42645e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.438904] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.439037] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.439037] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.443044] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.443044] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.443044] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.443044] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.443044] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.443044] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.443044] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e33b6cac-e9e7-4fe8-a87b-2dee2c42645e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.443044] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-1569a645-b31c-46d6-bf6d-8d945aec0f40 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.443044] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1569a645-b31c-46d6-bf6d-8d945aec0f40" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.443044] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1569a645-b31c-46d6-bf6d-8d945aec0f40" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.443044] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1569a645-b31c-46d6-bf6d-8d945aec0f40" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.443044] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1569a645-b31c-46d6-bf6d-8d945aec0f40',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.662943] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5251c5e-578a-48aa-8195-e1dc88834ad8 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.663180] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5251c5e-578a-48aa-8195-e1dc88834ad8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.663258] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5251c5e-578a-48aa-8195-e1dc88834ad8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.663516] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5251c5e-578a-48aa-8195-e1dc88834ad8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.663694] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.663801] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.663867] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.664028] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.664118] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.664210] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5251c5e-578a-48aa-8195-e1dc88834ad8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.664361] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5251c5e-578a-48aa-8195-e1dc88834ad8 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.664456] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5251c5e-578a-48aa-8195-e1dc88834ad8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.664516] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5251c5e-578a-48aa-8195-e1dc88834ad8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.664657] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5251c5e-578a-48aa-8195-e1dc88834ad8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.664793] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.664884] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.664936] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.665092] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.665168] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.665252] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5251c5e-578a-48aa-8195-e1dc88834ad8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.665339] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f5251c5e-578a-48aa-8195-e1dc88834ad8',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.712793] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7134cdd3-ca0e-4544-bb16-183af6eac784 in Status: SUCCESS [ 1252.713074] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7134cdd3-ca0e-4544-bb16-183af6eac784" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.943402] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.943576] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.944942] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1569a645-b31c-46d6-bf6d-8d945aec0f40 with status ACTIVE [ 1252.945237] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.945392] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.945515] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.945759] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.945903] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.946144] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.946270] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.946314] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.946485] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.946579] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.946866] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.947036] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.947103] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.947250] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.947339] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.947416] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1569a645-b31c-46d6-bf6d-8d945aec0f40 is going to be updated. [ 1252.948593] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e33b6cac-e9e7-4fe8-a87b-2dee2c42645e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.970095] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.970252] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.970327] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.970546] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.970689] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.970897] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1569a645-b31c-46d6-bf6d-8d945aec0f40" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.167768] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f5251c5e-578a-48aa-8195-e1dc88834ad8: rpc.has_security_group_logging(os_id): False [ 1253.188133] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.188133] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.188133] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.188133] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.188133] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.188580] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.188580] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.188580] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.188780] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.188780] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.188979] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.188979] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.188979] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.189253] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.189253] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.189389] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.189481] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.189550] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.189670] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.189729] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.189818] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f5251c5e-578a-48aa-8195-e1dc88834ad8 is going to be created. [ 1253.256079] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.256289] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.256340] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.256531] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.256734] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.311306] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5251c5e-578a-48aa-8195-e1dc88834ad8 in Status: IN_PROGRESS for 2s [ 1253.451177] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e33b6cac-e9e7-4fe8-a87b-2dee2c42645e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.563763] env[70392]: INFO networking_nsxv3.common.synchronization [req-f81fa9e2-136c-4365-99f8-4a7cdee5e13e req-c9fa6dbe-79ba-413e-8fca-06ee70b219b4 tempest-ListServersNegativeTestJSON-1390298334 tempest-ListServersNegativeTestJSON-1390298334-project-member] Enqueued Resource ID: e33b6cac-e9e7-4fe8-a87b-2dee2c42645e with Priority: HIGHEST for action security_group_members [ 1253.564036] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e33b6cac-e9e7-4fe8-a87b-2dee2c42645e with Priority: HIGHEST for action security_group_members [ 1253.564447] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.564447] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.860289] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-993 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.860591] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-993" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.860770] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-993" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.861090] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-993" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.861423] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.861605] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.861736] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.861982] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.862190] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.862448] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1253.862607] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1253.862773] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1253.862979] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1253.863172] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1253.863313] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1253.863461] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1253.884320] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1253.884567] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1253.884656] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1253.884866] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-993" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.885233] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-59796b24-5001-41a4-89f1-f7401a708e46 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.885429] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-59796b24-5001-41a4-89f1-f7401a708e46" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.885560] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-59796b24-5001-41a4-89f1-f7401a708e46" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.885905] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-59796b24-5001-41a4-89f1-f7401a708e46" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.886059] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('59796b24-5001-41a4-89f1-f7401a708e46',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.954101] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.954319] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.954423] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.954680] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.954811] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.954949] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e33b6cac-e9e7-4fe8-a87b-2dee2c42645e is going to be created. [ 1253.979636] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.979885] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.979942] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.980169] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.980415] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.991231] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e33b6cac-e9e7-4fe8-a87b-2dee2c42645e in Status: UNINITIALIZED for 2s [ 1254.388044] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.388292] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.388426] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.388709] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.388865] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.389038] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 59796b24-5001-41a4-89f1-f7401a708e46 not found, creating... [ 1254.389313] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.389508] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.389584] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.389804] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.389944] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.390254] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.390408] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.390529] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.390739] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.390878] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.391033] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 59796b24-5001-41a4-89f1-f7401a708e46 is going to be created. [ 1254.415450] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.415737] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.415827] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.416087] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.416338] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.416565] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-59796b24-5001-41a4-89f1-f7401a708e46" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.113457] env[70392]: INFO networking_nsxv3.common.synchronization [req-f81fa9e2-136c-4365-99f8-4a7cdee5e13e req-f5e53857-346a-43c5-8823-cf7137eb8cc8 service nova] Enqueued Resource ID: e33b6cac-e9e7-4fe8-a87b-2dee2c42645e with Priority: HIGHEST for action security_group_rules [ 1255.113754] env[70392]: INFO networking_nsxv3.common.synchronization [req-f81fa9e2-136c-4365-99f8-4a7cdee5e13e req-f5e53857-346a-43c5-8823-cf7137eb8cc8 service nova] Enqueued Resource ID: e33b6cac-e9e7-4fe8-a87b-2dee2c42645e with Priority: HIGHEST for action security_group_members [ 1255.113936] env[70392]: INFO networking_nsxv3.common.synchronization [req-f81fa9e2-136c-4365-99f8-4a7cdee5e13e req-f5e53857-346a-43c5-8823-cf7137eb8cc8 service nova] Enqueued Resource ID: 59796b24-5001-41a4-89f1-f7401a708e46 with Priority: HIGHEST for action port [ 1255.114591] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e33b6cac-e9e7-4fe8-a87b-2dee2c42645e with Priority: HIGHEST for action security_group_rules [ 1255.114723] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e33b6cac-e9e7-4fe8-a87b-2dee2c42645e with Priority: HIGHEST for action security_group_members [ 1255.114818] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59796b24-5001-41a4-89f1-f7401a708e46 with Priority: HIGHEST for action port [ 1255.115928] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.116053] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.116352] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.116451] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.116637] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-59796b24-5001-41a4-89f1-f7401a708e46 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.116737] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-59796b24-5001-41a4-89f1-f7401a708e46" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.116829] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-59796b24-5001-41a4-89f1-f7401a708e46" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.117038] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-59796b24-5001-41a4-89f1-f7401a708e46" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.117120] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('59796b24-5001-41a4-89f1-f7401a708e46',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.325545] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5251c5e-578a-48aa-8195-e1dc88834ad8 in Status: SUCCESS [ 1255.325733] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f5251c5e-578a-48aa-8195-e1dc88834ad8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.620247] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 59796b24-5001-41a4-89f1-f7401a708e46 with status ACTIVE [ 1255.620247] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.620247] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.620247] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.620247] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.620694] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.620694] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.620694] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.620825] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.620874] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.620959] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.621158] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.621550] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.621550] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.621550] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.621752] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.621752] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 59796b24-5001-41a4-89f1-f7401a708e46 is going to be updated. [ 1255.643975] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.643975] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.643975] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.643975] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.643975] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.643975] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-59796b24-5001-41a4-89f1-f7401a708e46" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.004051] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e33b6cac-e9e7-4fe8-a87b-2dee2c42645e in Status: SUCCESS [ 1256.004304] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.004482] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.004707] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.004948] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.005126] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.005235] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.005521] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.005666] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.005837] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.006274] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e33b6cac-e9e7-4fe8-a87b-2dee2c42645e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.007489] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.007598] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.007753] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.007871] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.007929] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.008132] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.008300] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.008399] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e33b6cac-e9e7-4fe8-a87b-2dee2c42645e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.323036] env[70392]: INFO networking_nsxv3.common.synchronization [req-f983dff1-f101-45ce-b343-77bdbac98e36 req-c2a19725-78e7-4a88-8b6c-60c3a2c446db tempest-ServerActionsTestOtherA-1411478130 tempest-ServerActionsTestOtherA-1411478130-project-member] Enqueued Resource ID: f5251c5e-578a-48aa-8195-e1dc88834ad8 with Priority: HIGHEST for action security_group_members [ 1256.324612] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5251c5e-578a-48aa-8195-e1dc88834ad8 with Priority: HIGHEST for action security_group_members [ 1256.324979] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5251c5e-578a-48aa-8195-e1dc88834ad8 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.325140] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5251c5e-578a-48aa-8195-e1dc88834ad8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.325226] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5251c5e-578a-48aa-8195-e1dc88834ad8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.325389] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5251c5e-578a-48aa-8195-e1dc88834ad8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.325557] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.325665] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.325739] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.325996] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.325996] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.326170] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5251c5e-578a-48aa-8195-e1dc88834ad8',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.370428] env[70392]: INFO networking_nsxv3.common.synchronization [req-f983dff1-f101-45ce-b343-77bdbac98e36 req-c2a19725-78e7-4a88-8b6c-60c3a2c446db tempest-ServerActionsTestOtherA-1411478130 tempest-ServerActionsTestOtherA-1411478130-project-member] Enqueued Resource ID: cc107d10-ea7f-41b3-8095-b7673d18e2b3 with Priority: HIGHEST for action port [ 1256.370939] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc107d10-ea7f-41b3-8095-b7673d18e2b3 with Priority: HIGHEST for action port [ 1256.371256] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-cc107d10-ea7f-41b3-8095-b7673d18e2b3 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.371376] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cc107d10-ea7f-41b3-8095-b7673d18e2b3" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.371444] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cc107d10-ea7f-41b3-8095-b7673d18e2b3" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.371647] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cc107d10-ea7f-41b3-8095-b7673d18e2b3" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.371735] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc107d10-ea7f-41b3-8095-b7673d18e2b3',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.510901] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.510901] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.510901] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e33b6cac-e9e7-4fe8-a87b-2dee2c42645e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.809905] env[70392]: INFO networking_nsxv3.common.synchronization [req-7c09a58e-e0f0-45ae-bb29-32faffea232d req-2723f174-c4bb-44e7-94f2-572a5e5c94f5 tempest-AttachVolumeShelveTestJSON-1019030511 tempest-AttachVolumeShelveTestJSON-1019030511-project-member] Enqueued Resource ID: ee8b641c-b2f7-4b94-85bb-98a31dba1604 with Priority: HIGHEST for action security_group_members [ 1256.810561] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee8b641c-b2f7-4b94-85bb-98a31dba1604 with Priority: HIGHEST for action security_group_members [ 1256.810803] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee8b641c-b2f7-4b94-85bb-98a31dba1604 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.810932] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee8b641c-b2f7-4b94-85bb-98a31dba1604" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.811100] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee8b641c-b2f7-4b94-85bb-98a31dba1604" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.817223] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee8b641c-b2f7-4b94-85bb-98a31dba1604" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.817223] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.817223] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.817223] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.817223] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.817223] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.817223] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee8b641c-b2f7-4b94-85bb-98a31dba1604',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.828259] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.828259] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.828450] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.828533] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.828618] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.828815] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.828909] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.828968] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.829223] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.829223] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.829928] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5251c5e-578a-48aa-8195-e1dc88834ad8 is going to be updated. [ 1256.868037] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.868037] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.868037] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.868037] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.868037] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.875708] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5251c5e-578a-48aa-8195-e1dc88834ad8 in Status: IN_PROGRESS for 2s [ 1256.877067] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cc107d10-ea7f-41b3-8095-b7673d18e2b3 with status ACTIVE [ 1256.877067] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.877067] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.877067] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.877276] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.877276] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.877587] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.877587] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.877587] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.878103] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.878103] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.878424] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.878563] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.878646] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.878822] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.878920] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.879038] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cc107d10-ea7f-41b3-8095-b7673d18e2b3 is going to be updated. [ 1256.903172] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.903408] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.903508] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.903747] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.904052] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.904195] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cc107d10-ea7f-41b3-8095-b7673d18e2b3" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.983079] env[70392]: INFO networking_nsxv3.common.synchronization [req-f81fa9e2-136c-4365-99f8-4a7cdee5e13e req-2f8b50a0-0a6f-4e64-ac36-e1ee763d3c34 tempest-ListServersNegativeTestJSON-1390298334 tempest-ListServersNegativeTestJSON-1390298334-project-member] Enqueued Resource ID: e33b6cac-e9e7-4fe8-a87b-2dee2c42645e with Priority: HIGHEST for action security_group_members [ 1256.983309] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e33b6cac-e9e7-4fe8-a87b-2dee2c42645e with Priority: HIGHEST for action security_group_members [ 1256.984077] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.984077] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.015852] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e33b6cac-e9e7-4fe8-a87b-2dee2c42645e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.320664] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.320852] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.320928] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.321206] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.321324] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.321538] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.321651] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.321713] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.321869] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.321947] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.322054] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee8b641c-b2f7-4b94-85bb-98a31dba1604 is going to be updated. [ 1257.364018] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.364018] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.364461] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.364461] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.364575] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.374974] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee8b641c-b2f7-4b94-85bb-98a31dba1604 in Status: IN_PROGRESS for 2s [ 1257.517951] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.518131] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.518350] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.518665] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.518750] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.518964] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e33b6cac-e9e7-4fe8-a87b-2dee2c42645e is going to be updated. [ 1257.552652] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-993 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.552777] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-993" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.552863] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-993" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.553177] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-993" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.553450] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.553617] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.553734] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.553969] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.554134] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.554419] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1257.554567] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1257.554690] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1257.554808] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1257.554928] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1257.555065] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1257.555232] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1257.557822] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.557946] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.558025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.558267] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.558412] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.568272] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e33b6cac-e9e7-4fe8-a87b-2dee2c42645e in Status: IN_PROGRESS for 2s [ 1257.578776] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1257.578962] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1257.579071] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1257.579591] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-993" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.579696] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-fae81c3b-4010-4f4e-b0d1-4acaee2e3834 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.579868] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-fae81c3b-4010-4f4e-b0d1-4acaee2e3834" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.579942] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-fae81c3b-4010-4f4e-b0d1-4acaee2e3834" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.580308] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-fae81c3b-4010-4f4e-b0d1-4acaee2e3834" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.580457] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fae81c3b-4010-4f4e-b0d1-4acaee2e3834',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.082747] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.082980] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.083136] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.083426] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.083585] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.083755] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port fae81c3b-4010-4f4e-b0d1-4acaee2e3834 not found, creating... [ 1258.084030] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.084198] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.084322] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.084548] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.084791] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.084969] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.085139] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.085260] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.085473] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.085611] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.085756] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: fae81c3b-4010-4f4e-b0d1-4acaee2e3834 is going to be created. [ 1258.107526] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.107785] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.107920] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.108250] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.108507] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.108803] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-fae81c3b-4010-4f4e-b0d1-4acaee2e3834" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.233468] env[70392]: INFO networking_nsxv3.common.synchronization [req-48643f3e-2e3f-4b55-9ef9-33a6ce83c549 req-2fe9fad1-62d1-4321-8531-03dd21bd8193 tempest-ServerAddressesTestJSON-338193336 tempest-ServerAddressesTestJSON-338193336-project-member] Enqueued Resource ID: 7134cdd3-ca0e-4544-bb16-183af6eac784 with Priority: HIGHEST for action security_group_members [ 1258.233956] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7134cdd3-ca0e-4544-bb16-183af6eac784 with Priority: HIGHEST for action security_group_members [ 1258.234282] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-7134cdd3-ca0e-4544-bb16-183af6eac784 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.234412] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7134cdd3-ca0e-4544-bb16-183af6eac784" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.234481] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7134cdd3-ca0e-4544-bb16-183af6eac784" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.234683] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7134cdd3-ca0e-4544-bb16-183af6eac784" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.234837] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.234933] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.234999] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.235151] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.235236] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.235329] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7134cdd3-ca0e-4544-bb16-183af6eac784',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.736998] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.737398] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.737398] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.737481] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.737574] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.737775] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.737874] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.737935] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.738101] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.738175] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.738287] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7134cdd3-ca0e-4544-bb16-183af6eac784 is going to be updated. [ 1258.772359] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.772729] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.772729] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.772823] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.773171] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.782140] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7134cdd3-ca0e-4544-bb16-183af6eac784 in Status: IN_PROGRESS for 2s [ 1258.812118] env[70392]: INFO networking_nsxv3.common.synchronization [req-f81fa9e2-136c-4365-99f8-4a7cdee5e13e req-fd6e4151-e776-4530-9407-1f198ac9d591 service nova] Enqueued Resource ID: e33b6cac-e9e7-4fe8-a87b-2dee2c42645e with Priority: HIGHEST for action security_group_rules [ 1258.812300] env[70392]: INFO networking_nsxv3.common.synchronization [req-f81fa9e2-136c-4365-99f8-4a7cdee5e13e req-fd6e4151-e776-4530-9407-1f198ac9d591 service nova] Enqueued Resource ID: e33b6cac-e9e7-4fe8-a87b-2dee2c42645e with Priority: HIGHEST for action security_group_members [ 1258.812443] env[70392]: INFO networking_nsxv3.common.synchronization [req-f81fa9e2-136c-4365-99f8-4a7cdee5e13e req-fd6e4151-e776-4530-9407-1f198ac9d591 service nova] Enqueued Resource ID: fae81c3b-4010-4f4e-b0d1-4acaee2e3834 with Priority: HIGHEST for action port [ 1258.812678] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e33b6cac-e9e7-4fe8-a87b-2dee2c42645e with Priority: HIGHEST for action security_group_rules [ 1258.812803] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e33b6cac-e9e7-4fe8-a87b-2dee2c42645e with Priority: HIGHEST for action security_group_members [ 1258.812897] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fae81c3b-4010-4f4e-b0d1-4acaee2e3834 with Priority: HIGHEST for action port [ 1258.813479] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.814739] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.814739] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.814739] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.814739] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-fae81c3b-4010-4f4e-b0d1-4acaee2e3834 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.814739] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fae81c3b-4010-4f4e-b0d1-4acaee2e3834" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.814739] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fae81c3b-4010-4f4e-b0d1-4acaee2e3834" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.814739] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fae81c3b-4010-4f4e-b0d1-4acaee2e3834" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.814739] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fae81c3b-4010-4f4e-b0d1-4acaee2e3834',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.886774] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5251c5e-578a-48aa-8195-e1dc88834ad8 in Status: SUCCESS [ 1258.886967] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5251c5e-578a-48aa-8195-e1dc88834ad8 deletion is rescheduled due to dependency. [ 1258.887103] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5251c5e-578a-48aa-8195-e1dc88834ad8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.259181] env[70392]: INFO networking_nsxv3.common.synchronization [req-429fdce5-7d75-45e0-948a-4e0025dcc67a req-4c41c099-1dd8-4679-a68e-a07ed09adf0c tempest-ServersTestJSON-507292717 tempest-ServersTestJSON-507292717-project-member] Enqueued Resource ID: 19062702-bd29-4477-a732-5169f347b4da with Priority: HIGHEST for action security_group_members [ 1259.259702] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19062702-bd29-4477-a732-5169f347b4da with Priority: HIGHEST for action security_group_members [ 1259.259994] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-19062702-bd29-4477-a732-5169f347b4da taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.260125] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.260191] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.260366] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.260509] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.260607] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.261251] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.261251] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.261251] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.261251] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.320950] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fae81c3b-4010-4f4e-b0d1-4acaee2e3834 with status ACTIVE [ 1259.320950] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.320950] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.320950] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.320950] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.320950] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.320950] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.320950] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.320950] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.320950] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.320950] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.320950] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.320950] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.320950] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.320950] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.320950] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.320950] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fae81c3b-4010-4f4e-b0d1-4acaee2e3834 is going to be updated. [ 1259.344226] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.344226] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.344226] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.344226] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.344226] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.344226] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fae81c3b-4010-4f4e-b0d1-4acaee2e3834" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.385881] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee8b641c-b2f7-4b94-85bb-98a31dba1604 in Status: SUCCESS [ 1259.385881] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee8b641c-b2f7-4b94-85bb-98a31dba1604 deletion is rescheduled due to dependency. [ 1259.385881] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee8b641c-b2f7-4b94-85bb-98a31dba1604" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.577958] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e33b6cac-e9e7-4fe8-a87b-2dee2c42645e in Status: SUCCESS [ 1259.578293] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.578469] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.578702] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.578941] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.579091] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.579160] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.579387] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.579509] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.579568] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e33b6cac-e9e7-4fe8-a87b-2dee2c42645e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.613308] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-219 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.613495] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-219" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.613626] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-219" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.613935] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-219" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.614222] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.614434] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.614606] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.614886] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.615086] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.615351] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1259.615521] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1259.615669] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1259.615820] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1259.616011] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1259.616170] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1259.616373] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1259.635656] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1259.635857] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1259.636017] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1259.636215] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-219" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.636562] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-90af4fd9-eb0d-4a82-a438-c3a597555b05 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.636800] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-90af4fd9-eb0d-4a82-a438-c3a597555b05" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.636872] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-90af4fd9-eb0d-4a82-a438-c3a597555b05" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.637262] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-90af4fd9-eb0d-4a82-a438-c3a597555b05" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.637429] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('90af4fd9-eb0d-4a82-a438-c3a597555b05',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.762632] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.081517] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e33b6cac-e9e7-4fe8-a87b-2dee2c42645e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.139754] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.140043] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.140181] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.140579] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.140769] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.140936] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 90af4fd9-eb0d-4a82-a438-c3a597555b05 not found, creating... [ 1260.141234] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.141430] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.141618] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.141971] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.142249] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.142587] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.142786] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.142874] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.143132] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.143283] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.143434] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 90af4fd9-eb0d-4a82-a438-c3a597555b05 is going to be created. [ 1260.164494] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.164807] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.164936] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.165236] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.165479] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.165716] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-90af4fd9-eb0d-4a82-a438-c3a597555b05" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.266281] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.583779] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e33b6cac-e9e7-4fe8-a87b-2dee2c42645e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.769406] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.769932] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.769932] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.769932] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.770103] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.770103] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19062702-bd29-4477-a732-5169f347b4da is going to be updated. [ 1260.802277] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7134cdd3-ca0e-4544-bb16-183af6eac784 in Status: SUCCESS [ 1260.802523] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7134cdd3-ca0e-4544-bb16-183af6eac784 deletion is rescheduled due to dependency. [ 1260.802669] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7134cdd3-ca0e-4544-bb16-183af6eac784" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.830526] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.830699] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.830862] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.831268] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.831579] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.844090] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19062702-bd29-4477-a732-5169f347b4da in Status: IN_PROGRESS for 2s [ 1260.954411] env[70392]: INFO networking_nsxv3.common.synchronization [req-429fdce5-7d75-45e0-948a-4e0025dcc67a req-2b26de17-2eaf-4be3-bd8c-ae7fdad86b87 service nova] Enqueued Resource ID: 19062702-bd29-4477-a732-5169f347b4da with Priority: HIGHEST for action security_group_rules [ 1260.954765] env[70392]: INFO networking_nsxv3.common.synchronization [req-429fdce5-7d75-45e0-948a-4e0025dcc67a req-2b26de17-2eaf-4be3-bd8c-ae7fdad86b87 service nova] Enqueued Resource ID: 19062702-bd29-4477-a732-5169f347b4da with Priority: HIGHEST for action security_group_members [ 1260.955014] env[70392]: INFO networking_nsxv3.common.synchronization [req-429fdce5-7d75-45e0-948a-4e0025dcc67a req-2b26de17-2eaf-4be3-bd8c-ae7fdad86b87 service nova] Enqueued Resource ID: 90af4fd9-eb0d-4a82-a438-c3a597555b05 with Priority: HIGHEST for action port [ 1260.956015] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19062702-bd29-4477-a732-5169f347b4da with Priority: HIGHEST for action security_group_rules [ 1260.956339] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19062702-bd29-4477-a732-5169f347b4da with Priority: HIGHEST for action security_group_members [ 1260.956518] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90af4fd9-eb0d-4a82-a438-c3a597555b05 with Priority: HIGHEST for action port [ 1260.956921] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-19062702-bd29-4477-a732-5169f347b4da taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.957114] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.957216] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.957504] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.957638] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.960460] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-19062702-bd29-4477-a732-5169f347b4da taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.960613] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.960941] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-90af4fd9-eb0d-4a82-a438-c3a597555b05 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.961110] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-90af4fd9-eb0d-4a82-a438-c3a597555b05" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.961213] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-90af4fd9-eb0d-4a82-a438-c3a597555b05" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.961492] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-90af4fd9-eb0d-4a82-a438-c3a597555b05" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.961613] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('90af4fd9-eb0d-4a82-a438-c3a597555b05',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.086862] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.087163] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.087163] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.087341] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.087436] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.087543] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e33b6cac-e9e7-4fe8-a87b-2dee2c42645e is going to be updated. [ 1261.134631] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.134860] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.134951] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.135243] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.135458] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.150426] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e33b6cac-e9e7-4fe8-a87b-2dee2c42645e in Status: IN_PROGRESS for 2s [ 1261.460902] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-19062702-bd29-4477-a732-5169f347b4da taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.461121] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.465352] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 90af4fd9-eb0d-4a82-a438-c3a597555b05 with status ACTIVE [ 1261.465556] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.465677] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.465740] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.465957] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.466055] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.466280] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.466403] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.466471] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.467145] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.467145] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.467145] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.467145] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.467145] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.467374] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.467374] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.467374] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 90af4fd9-eb0d-4a82-a438-c3a597555b05 is going to be updated. [ 1261.491427] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.491427] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.491676] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.491817] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.491955] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.492134] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-90af4fd9-eb0d-4a82-a438-c3a597555b05" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.731509] env[70392]: INFO networking_nsxv3.common.synchronization [req-5d8ed127-c568-4ced-a368-e75bb1dc87fc req-d87cc962-dcac-444a-a4c5-74d565bc1bdb tempest-ServerMetadataTestJSON-2068834782 tempest-ServerMetadataTestJSON-2068834782-project-member] Enqueued Resource ID: 63340db4-2f8e-4cd1-a989-33f56aac8213 with Priority: HIGHEST for action security_group_members [ 1261.732034] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63340db4-2f8e-4cd1-a989-33f56aac8213 with Priority: HIGHEST for action security_group_members [ 1261.732337] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-63340db4-2f8e-4cd1-a989-33f56aac8213 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.732458] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63340db4-2f8e-4cd1-a989-33f56aac8213" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.732523] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63340db4-2f8e-4cd1-a989-33f56aac8213" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.732766] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63340db4-2f8e-4cd1-a989-33f56aac8213" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.732920] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.733025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.733088] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.733236] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.733319] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.733438] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63340db4-2f8e-4cd1-a989-33f56aac8213',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.160459] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-361 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.160814] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-361" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.160814] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-361" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.161106] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-361" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.161384] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.161618] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.161754] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.161984] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.162157] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.162383] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1262.162514] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1262.162619] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1262.162738] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1262.162923] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1262.163081] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1262.163229] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1262.183964] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1262.184195] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1262.184377] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1262.184597] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-361" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.185028] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-90af8a2b-cb66-4f5f-9908-3a78e3781f5e taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.185231] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-90af8a2b-cb66-4f5f-9908-3a78e3781f5e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.185365] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-90af8a2b-cb66-4f5f-9908-3a78e3781f5e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.185709] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-90af8a2b-cb66-4f5f-9908-3a78e3781f5e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.185886] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('90af8a2b-cb66-4f5f-9908-3a78e3781f5e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.236257] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.236485] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.236485] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.236699] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.236792] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.236994] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.237102] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.237167] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.237316] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.237394] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.237479] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63340db4-2f8e-4cd1-a989-33f56aac8213 already deleted. [ 1262.237560] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63340db4-2f8e-4cd1-a989-33f56aac8213" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.689076] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.689273] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.689329] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.689584] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.689748] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.689917] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 90af8a2b-cb66-4f5f-9908-3a78e3781f5e not found, creating... [ 1262.690202] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.690369] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.690494] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.690737] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.690861] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.691168] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.691330] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.691452] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.691669] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.691809] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.691955] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 90af8a2b-cb66-4f5f-9908-3a78e3781f5e is going to be created. [ 1262.712462] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.712672] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.712806] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.713109] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.713342] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.713575] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-90af8a2b-cb66-4f5f-9908-3a78e3781f5e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.854464] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19062702-bd29-4477-a732-5169f347b4da in Status: SUCCESS [ 1262.854801] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.855007] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.855310] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.855434] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.855566] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.855629] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.855793] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.856189] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.856189] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.165178] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e33b6cac-e9e7-4fe8-a87b-2dee2c42645e in Status: SUCCESS [ 1263.165530] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.165622] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.165842] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.166069] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.166195] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.166287] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.166451] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.166618] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.166684] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.166798] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.166892] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.166955] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.167117] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.167262] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.167359] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.167421] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.167580] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.167657] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.167740] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.167836] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e33b6cac-e9e7-4fe8-a87b-2dee2c42645e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.168798] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.168980] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.169148] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.169256] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.169345] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.169509] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.169588] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.169680] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e33b6cac-e9e7-4fe8-a87b-2dee2c42645e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.359811] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.624182] env[70392]: INFO networking_nsxv3.common.synchronization [req-5d8ed127-c568-4ced-a368-e75bb1dc87fc req-c8a9457c-999e-4ae9-a61f-6c6ebdf4ae36 service nova] Enqueued Resource ID: 63340db4-2f8e-4cd1-a989-33f56aac8213 with Priority: HIGHEST for action security_group_rules [ 1263.624182] env[70392]: INFO networking_nsxv3.common.synchronization [req-5d8ed127-c568-4ced-a368-e75bb1dc87fc req-c8a9457c-999e-4ae9-a61f-6c6ebdf4ae36 service nova] Enqueued Resource ID: 63340db4-2f8e-4cd1-a989-33f56aac8213 with Priority: HIGHEST for action security_group_members [ 1263.624182] env[70392]: INFO networking_nsxv3.common.synchronization [req-5d8ed127-c568-4ced-a368-e75bb1dc87fc req-c8a9457c-999e-4ae9-a61f-6c6ebdf4ae36 service nova] Enqueued Resource ID: 90af8a2b-cb66-4f5f-9908-3a78e3781f5e with Priority: HIGHEST for action port [ 1263.624618] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63340db4-2f8e-4cd1-a989-33f56aac8213 with Priority: HIGHEST for action security_group_rules [ 1263.624754] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63340db4-2f8e-4cd1-a989-33f56aac8213 with Priority: HIGHEST for action security_group_members [ 1263.624876] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90af8a2b-cb66-4f5f-9908-3a78e3781f5e with Priority: HIGHEST for action port [ 1263.625185] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-63340db4-2f8e-4cd1-a989-33f56aac8213 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.625341] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-63340db4-2f8e-4cd1-a989-33f56aac8213" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.625408] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-63340db4-2f8e-4cd1-a989-33f56aac8213" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.625667] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-63340db4-2f8e-4cd1-a989-33f56aac8213" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.625749] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('63340db4-2f8e-4cd1-a989-33f56aac8213',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.626828] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-63340db4-2f8e-4cd1-a989-33f56aac8213 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.626967] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63340db4-2f8e-4cd1-a989-33f56aac8213" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.627055] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63340db4-2f8e-4cd1-a989-33f56aac8213" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.627257] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63340db4-2f8e-4cd1-a989-33f56aac8213" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.628037] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.628037] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.628037] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.628037] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.628037] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.628037] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63340db4-2f8e-4cd1-a989-33f56aac8213',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.629651] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-90af8a2b-cb66-4f5f-9908-3a78e3781f5e taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.629815] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-90af8a2b-cb66-4f5f-9908-3a78e3781f5e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.629888] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-90af8a2b-cb66-4f5f-9908-3a78e3781f5e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.630092] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-90af8a2b-cb66-4f5f-9908-3a78e3781f5e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.630169] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('90af8a2b-cb66-4f5f-9908-3a78e3781f5e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.671360] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e33b6cac-e9e7-4fe8-a87b-2dee2c42645e: rpc.has_security_group_logging(os_id): False [ 1263.672972] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e33b6cac-e9e7-4fe8-a87b-2dee2c42645e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.695609] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.695609] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.695609] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.695842] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.695878] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.696098] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.696209] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.696341] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.696533] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.696613] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.696807] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.696905] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.696969] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.697124] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.697200] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.697381] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.697472] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.697580] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.697681] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.697752] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.697838] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e33b6cac-e9e7-4fe8-a87b-2dee2c42645e is going to be created. [ 1263.774039] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.774039] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.776028] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.776028] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.776028] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.786523] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e33b6cac-e9e7-4fe8-a87b-2dee2c42645e in Status: IN_PROGRESS for 2s [ 1263.867241] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.135021] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-63340db4-2f8e-4cd1-a989-33f56aac8213 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.135021] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63340db4-2f8e-4cd1-a989-33f56aac8213" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.135021] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('63340db4-2f8e-4cd1-a989-33f56aac8213',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.135021] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 90af8a2b-cb66-4f5f-9908-3a78e3781f5e with status ACTIVE [ 1264.135021] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.135021] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.135021] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.135021] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.135021] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.135021] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.135021] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.135021] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.135021] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.135021] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.135616] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.135616] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.135616] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.135616] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.135616] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.136307] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 90af8a2b-cb66-4f5f-9908-3a78e3781f5e is going to be updated. [ 1264.161724] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.163111] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.163111] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.163111] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.163111] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.163111] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-90af8a2b-cb66-4f5f-9908-3a78e3781f5e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.176276] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e33b6cac-e9e7-4fe8-a87b-2dee2c42645e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.369084] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.369291] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.369698] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.369824] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.370066] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.370315] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19062702-bd29-4477-a732-5169f347b4da is going to be updated. [ 1264.408989] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.409222] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.409222] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.409444] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.409631] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.421999] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19062702-bd29-4477-a732-5169f347b4da in Status: IN_PROGRESS for 2s [ 1264.520643] env[70392]: INFO networking_nsxv3.common.synchronization [None req-e79d54de-025e-4137-aec1-9f688aaf2a10 tempest-AttachVolumeShelveTestJSON-1019030511 tempest-AttachVolumeShelveTestJSON-1019030511-project-member] Enqueued Resource ID: 2515ad2c-fd11-420c-a9b5-5e230c52781f with Priority: HIGHEST for action security_group_rules [ 1264.521265] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2515ad2c-fd11-420c-a9b5-5e230c52781f with Priority: HIGHEST for action security_group_rules [ 1264.522313] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2515ad2c-fd11-420c-a9b5-5e230c52781f taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.522313] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2515ad2c-fd11-420c-a9b5-5e230c52781f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.522474] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2515ad2c-fd11-420c-a9b5-5e230c52781f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.522654] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2515ad2c-fd11-420c-a9b5-5e230c52781f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.522744] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2515ad2c-fd11-420c-a9b5-5e230c52781f',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.613207] env[70392]: INFO networking_nsxv3.common.synchronization [None req-2e8282f0-e5ed-42a5-9435-f756abd7c665 tempest-AttachVolumeShelveTestJSON-1019030511 tempest-AttachVolumeShelveTestJSON-1019030511-project-member] Enqueued Resource ID: 2515ad2c-fd11-420c-a9b5-5e230c52781f with Priority: HIGHEST for action security_group_rules [ 1264.613764] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2515ad2c-fd11-420c-a9b5-5e230c52781f with Priority: HIGHEST for action security_group_rules [ 1264.614175] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2515ad2c-fd11-420c-a9b5-5e230c52781f taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.614289] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2515ad2c-fd11-420c-a9b5-5e230c52781f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.638315] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('63340db4-2f8e-4cd1-a989-33f56aac8213',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.678086] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.678086] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.678086] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.678086] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.680775] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.680775] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e33b6cac-e9e7-4fe8-a87b-2dee2c42645e is going to be updated. [ 1264.711564] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.711706] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.711785] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.711994] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.712158] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.724195] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e33b6cac-e9e7-4fe8-a87b-2dee2c42645e in Status: IN_PROGRESS for 2s [ 1265.052020] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.052020] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.052020] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.052020] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.052020] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.052020] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2515ad2c-fd11-420c-a9b5-5e230c52781f already deleted. [ 1265.052020] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2515ad2c-fd11-420c-a9b5-5e230c52781f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.052020] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2515ad2c-fd11-420c-a9b5-5e230c52781f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.052020] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2515ad2c-fd11-420c-a9b5-5e230c52781f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.052020] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2515ad2c-fd11-420c-a9b5-5e230c52781f',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.141317] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.141499] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.141570] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.141863] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.141916] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.141989] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63340db4-2f8e-4cd1-a989-33f56aac8213 is going to be created. [ 1265.173581] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.173744] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.173744] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.173956] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.174159] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.188285] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63340db4-2f8e-4cd1-a989-33f56aac8213 in Status: UNINITIALIZED for 2s [ 1265.574697] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.574906] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.574906] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.575183] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.575289] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.575390] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2515ad2c-fd11-420c-a9b5-5e230c52781f already deleted. [ 1265.575480] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2515ad2c-fd11-420c-a9b5-5e230c52781f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.801675] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e33b6cac-e9e7-4fe8-a87b-2dee2c42645e in Status: SUCCESS [ 1265.803441] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.803441] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.803441] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.803441] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e33b6cac-e9e7-4fe8-a87b-2dee2c42645e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.307056] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.307056] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.438607] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19062702-bd29-4477-a732-5169f347b4da in Status: SUCCESS [ 1266.438769] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.439040] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.439207] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.440028] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.440028] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.440028] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.440028] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.440028] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.440028] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.440028] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.734975] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e33b6cac-e9e7-4fe8-a87b-2dee2c42645e in Status: SUCCESS [ 1266.735322] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.735508] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.735733] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.735987] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.736142] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.736209] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.736617] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.736790] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.736982] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e33b6cac-e9e7-4fe8-a87b-2dee2c42645e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.943182] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-19062702-bd29-4477-a732-5169f347b4da taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.943761] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.943890] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.944152] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.944615] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.944615] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.944819] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.944819] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.944905] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.944998] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.945186] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-19062702-bd29-4477-a732-5169f347b4da taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.946168] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.946168] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.946168] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.946168] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.946168] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.946168] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.946168] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.946168] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.946168] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.946538] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.200149] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63340db4-2f8e-4cd1-a989-33f56aac8213 in Status: SUCCESS [ 1267.200392] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63340db4-2f8e-4cd1-a989-33f56aac8213" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.200580] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63340db4-2f8e-4cd1-a989-33f56aac8213" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.200939] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63340db4-2f8e-4cd1-a989-33f56aac8213" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.201325] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.201458] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.201522] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.201699] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.201784] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.202014] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63340db4-2f8e-4cd1-a989-33f56aac8213" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.202014] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('63340db4-2f8e-4cd1-a989-33f56aac8213',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.242548] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e33b6cac-e9e7-4fe8-a87b-2dee2c42645e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.449778] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 19062702-bd29-4477-a732-5169f347b4da: rpc.has_security_group_logging(os_id): False [ 1267.473835] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.473974] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.474050] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.474266] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.474382] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.474659] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.474772] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.474836] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.474989] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.475081] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.475265] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.475356] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.475410] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.475572] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.475660] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.476091] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.476091] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.476091] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.476091] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.476324] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.476324] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 19062702-bd29-4477-a732-5169f347b4da is going to be updated. [ 1267.550526] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.550526] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.550526] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.551018] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.551018] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.586696] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 19062702-bd29-4477-a732-5169f347b4da in Status: IN_PROGRESS for 2s [ 1267.705018] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-63340db4-2f8e-4cd1-a989-33f56aac8213 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.705018] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63340db4-2f8e-4cd1-a989-33f56aac8213" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.705018] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63340db4-2f8e-4cd1-a989-33f56aac8213" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.705334] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63340db4-2f8e-4cd1-a989-33f56aac8213" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.705554] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.705665] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.705732] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.705909] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.706021] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.706156] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63340db4-2f8e-4cd1-a989-33f56aac8213" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.706253] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-63340db4-2f8e-4cd1-a989-33f56aac8213 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.706411] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63340db4-2f8e-4cd1-a989-33f56aac8213" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.706474] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63340db4-2f8e-4cd1-a989-33f56aac8213" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.706614] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63340db4-2f8e-4cd1-a989-33f56aac8213" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.706758] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.706867] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.706940] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.707055] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.707130] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.707213] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63340db4-2f8e-4cd1-a989-33f56aac8213" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.707316] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('63340db4-2f8e-4cd1-a989-33f56aac8213',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.748872] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e33b6cac-e9e7-4fe8-a87b-2dee2c42645e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.211279] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 63340db4-2f8e-4cd1-a989-33f56aac8213: rpc.has_security_group_logging(os_id): False [ 1268.229618] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.229818] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.229818] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.229995] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.230105] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.230321] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.230425] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.230490] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.230670] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.230973] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.230973] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.230973] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.231141] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.231178] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.231260] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.231437] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.231525] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.231587] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.231726] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.231798] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.231884] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 63340db4-2f8e-4cd1-a989-33f56aac8213 is going to be created. [ 1268.251930] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.252168] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.252168] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.252385] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.252479] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.252581] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e33b6cac-e9e7-4fe8-a87b-2dee2c42645e is going to be updated. [ 1268.280591] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.280823] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.280823] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.281018] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.281169] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.289899] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e33b6cac-e9e7-4fe8-a87b-2dee2c42645e in Status: IN_PROGRESS for 2s [ 1268.306094] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.306280] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.306280] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.306510] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.306790] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.319027] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63340db4-2f8e-4cd1-a989-33f56aac8213 in Status: IN_PROGRESS for 2s [ 1269.604721] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 19062702-bd29-4477-a732-5169f347b4da in Status: SUCCESS [ 1269.605102] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.615403] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1269.615552] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=4 [ 1269.891588] env[70392]: INFO networking_nsxv3.common.synchronization [req-0d8aa551-f1cb-4faf-8bb1-57b83230e35a req-88744a16-d465-4e64-9df9-838c62a7b124 tempest-ListServersNegativeTestJSON-1390298334 tempest-ListServersNegativeTestJSON-1390298334-project-member] Enqueued Resource ID: e33b6cac-e9e7-4fe8-a87b-2dee2c42645e with Priority: HIGHEST for action security_group_members [ 1269.891846] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e33b6cac-e9e7-4fe8-a87b-2dee2c42645e with Priority: HIGHEST for action security_group_members [ 1269.892420] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.892420] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.299965] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e33b6cac-e9e7-4fe8-a87b-2dee2c42645e in Status: SUCCESS [ 1270.300194] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.300330] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.300552] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.300797] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.300932] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.300996] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.301176] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.301256] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.301345] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.301445] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e33b6cac-e9e7-4fe8-a87b-2dee2c42645e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.302294] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.302455] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.302632] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.302734] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.302798] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.302938] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.303022] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.303109] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e33b6cac-e9e7-4fe8-a87b-2dee2c42645e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.331556] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63340db4-2f8e-4cd1-a989-33f56aac8213 in Status: SUCCESS [ 1270.331853] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-63340db4-2f8e-4cd1-a989-33f56aac8213" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.589554] env[70392]: INFO networking_nsxv3.common.synchronization [req-bbac1e91-963c-43aa-89c7-9a97011a5547 req-551ed5c2-1ad4-4ca7-bdd9-0c3a1fbf3337 tempest-AttachVolumeShelveTestJSON-1019030511 tempest-AttachVolumeShelveTestJSON-1019030511-project-member] Enqueued Resource ID: 2515ad2c-fd11-420c-a9b5-5e230c52781f with Priority: HIGHEST for action security_group_members [ 1270.590128] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2515ad2c-fd11-420c-a9b5-5e230c52781f with Priority: HIGHEST for action security_group_members [ 1270.590456] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-2515ad2c-fd11-420c-a9b5-5e230c52781f taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.590633] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2515ad2c-fd11-420c-a9b5-5e230c52781f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.590718] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2515ad2c-fd11-420c-a9b5-5e230c52781f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.590970] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2515ad2c-fd11-420c-a9b5-5e230c52781f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.591175] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.591278] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.591342] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.591533] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.591568] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.591661] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2515ad2c-fd11-420c-a9b5-5e230c52781f',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.804527] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.804819] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.807080] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e33b6cac-e9e7-4fe8-a87b-2dee2c42645e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.972624] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-109 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.973040] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-109" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.973219] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-109" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.973362] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-109" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.973635] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.973799] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.973913] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.974247] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.974393] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.974609] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1270.974727] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1270.974840] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1270.974951] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1270.975079] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1270.975194] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1270.975323] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1271.003229] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1271.003653] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1271.003653] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1271.003837] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-109" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.004229] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-347e97f8-125e-4175-ad89-8fdf1e9adc77 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.004478] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-347e97f8-125e-4175-ad89-8fdf1e9adc77" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.004573] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-347e97f8-125e-4175-ad89-8fdf1e9adc77" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.005044] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-347e97f8-125e-4175-ad89-8fdf1e9adc77" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.005208] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('347e97f8-125e-4175-ad89-8fdf1e9adc77',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.093920] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.094275] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.094275] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.094555] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.094555] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.094660] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.094757] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.094757] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.095207] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.095207] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.095207] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2515ad2c-fd11-420c-a9b5-5e230c52781f already deleted. [ 1271.095207] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2515ad2c-fd11-420c-a9b5-5e230c52781f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.309166] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e33b6cac-e9e7-4fe8-a87b-2dee2c42645e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.508225] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.508529] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.508710] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.509039] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.509213] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.509412] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 347e97f8-125e-4175-ad89-8fdf1e9adc77 not found, creating... [ 1271.509684] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.509846] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.509968] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.510259] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.510441] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.510788] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.510954] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.511092] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.511353] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.511485] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.511611] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 347e97f8-125e-4175-ad89-8fdf1e9adc77 is going to be created. [ 1271.534295] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.534666] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.534666] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.534939] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.535241] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.535513] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-347e97f8-125e-4175-ad89-8fdf1e9adc77" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.812024] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.812434] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.812434] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.812564] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.812614] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.812750] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e33b6cac-e9e7-4fe8-a87b-2dee2c42645e is going to be updated. [ 1271.851161] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.851352] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.851352] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.851562] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.851717] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.864559] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e33b6cac-e9e7-4fe8-a87b-2dee2c42645e in Status: IN_PROGRESS for 2s [ 1272.336144] env[70392]: INFO networking_nsxv3.common.synchronization [req-bbac1e91-963c-43aa-89c7-9a97011a5547 req-13d512ea-7803-4a00-a503-2a8045b29f84 service nova] Enqueued Resource ID: 2515ad2c-fd11-420c-a9b5-5e230c52781f with Priority: HIGHEST for action security_group_rules [ 1272.336401] env[70392]: INFO networking_nsxv3.common.synchronization [req-bbac1e91-963c-43aa-89c7-9a97011a5547 req-13d512ea-7803-4a00-a503-2a8045b29f84 service nova] Enqueued Resource ID: 2515ad2c-fd11-420c-a9b5-5e230c52781f with Priority: HIGHEST for action security_group_members [ 1272.336524] env[70392]: INFO networking_nsxv3.common.synchronization [req-bbac1e91-963c-43aa-89c7-9a97011a5547 req-13d512ea-7803-4a00-a503-2a8045b29f84 service nova] Enqueued Resource ID: 347e97f8-125e-4175-ad89-8fdf1e9adc77 with Priority: HIGHEST for action port [ 1272.337181] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2515ad2c-fd11-420c-a9b5-5e230c52781f with Priority: HIGHEST for action security_group_rules [ 1272.337330] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2515ad2c-fd11-420c-a9b5-5e230c52781f with Priority: HIGHEST for action security_group_members [ 1272.337430] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 347e97f8-125e-4175-ad89-8fdf1e9adc77 with Priority: HIGHEST for action port [ 1272.337775] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2515ad2c-fd11-420c-a9b5-5e230c52781f taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.337921] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2515ad2c-fd11-420c-a9b5-5e230c52781f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.337990] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2515ad2c-fd11-420c-a9b5-5e230c52781f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.338245] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2515ad2c-fd11-420c-a9b5-5e230c52781f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.338335] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2515ad2c-fd11-420c-a9b5-5e230c52781f',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.339395] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-2515ad2c-fd11-420c-a9b5-5e230c52781f taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.339582] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2515ad2c-fd11-420c-a9b5-5e230c52781f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.339654] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2515ad2c-fd11-420c-a9b5-5e230c52781f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.339845] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2515ad2c-fd11-420c-a9b5-5e230c52781f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.339997] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.340139] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.340208] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.340362] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.340921] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.341062] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2515ad2c-fd11-420c-a9b5-5e230c52781f',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.346022] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-347e97f8-125e-4175-ad89-8fdf1e9adc77 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.346022] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-347e97f8-125e-4175-ad89-8fdf1e9adc77" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.346022] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-347e97f8-125e-4175-ad89-8fdf1e9adc77" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.346022] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-347e97f8-125e-4175-ad89-8fdf1e9adc77" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.346022] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('347e97f8-125e-4175-ad89-8fdf1e9adc77',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.844032] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2515ad2c-fd11-420c-a9b5-5e230c52781f',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.845661] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-2515ad2c-fd11-420c-a9b5-5e230c52781f taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.846187] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2515ad2c-fd11-420c-a9b5-5e230c52781f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.846187] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 347e97f8-125e-4175-ad89-8fdf1e9adc77 with status ACTIVE [ 1272.846388] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.846554] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.846653] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.846933] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.847084] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.847330] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.847472] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.847570] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.847876] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.848015] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.848282] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.848428] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.848528] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.848755] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.848868] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.848991] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 347e97f8-125e-4175-ad89-8fdf1e9adc77 is going to be updated. [ 1272.869899] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.870138] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.870201] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.870463] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.870656] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.870889] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-347e97f8-125e-4175-ad89-8fdf1e9adc77" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.150799] env[70392]: INFO networking_nsxv3.common.synchronization [req-51801396-43df-45b6-87ed-0828a75641c2 req-358dbb78-202e-4954-8407-aaa99cb5fb8a tempest-ServersTestJSON-507292717 tempest-ServersTestJSON-507292717-project-member] Enqueued Resource ID: 19062702-bd29-4477-a732-5169f347b4da with Priority: HIGHEST for action security_group_members [ 1273.151098] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19062702-bd29-4477-a732-5169f347b4da with Priority: HIGHEST for action security_group_members [ 1273.151258] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-19062702-bd29-4477-a732-5169f347b4da taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.151384] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.151469] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.151644] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.151802] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.151898] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.151958] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.152116] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.152286] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.152286] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.346539] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2515ad2c-fd11-420c-a9b5-5e230c52781f',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.655064] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.849699] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.850057] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.850057] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.850151] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.850243] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.850344] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2515ad2c-fd11-420c-a9b5-5e230c52781f is going to be created. [ 1273.876467] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e33b6cac-e9e7-4fe8-a87b-2dee2c42645e in Status: SUCCESS [ 1273.876766] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.876950] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.877178] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.877369] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.877486] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.877551] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.877704] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.877784] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.877870] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.878043] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.878175] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.878242] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.878389] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.878590] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.878739] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.878818] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.879409] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.879409] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.879409] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.879409] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e33b6cac-e9e7-4fe8-a87b-2dee2c42645e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.881034] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.881177] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.881230] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.881389] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.881584] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.890331] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2515ad2c-fd11-420c-a9b5-5e230c52781f in Status: UNINITIALIZED for 2s [ 1274.157888] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.383721] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e33b6cac-e9e7-4fe8-a87b-2dee2c42645e: rpc.has_security_group_logging(os_id): False [ 1274.404208] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.404208] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.404208] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.404208] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.404208] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.404479] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.404527] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.404758] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.404758] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.404842] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.404981] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.405083] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.405143] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.405279] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.405353] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.405571] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.405718] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.405823] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.406081] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.406191] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.406282] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e33b6cac-e9e7-4fe8-a87b-2dee2c42645e is going to be updated. [ 1274.480351] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.480490] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.480593] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.480782] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.481276] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.515605] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e33b6cac-e9e7-4fe8-a87b-2dee2c42645e in Status: IN_PROGRESS for 2s [ 1274.660561] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.660862] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.660862] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.661050] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.661050] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.661329] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19062702-bd29-4477-a732-5169f347b4da is going to be updated. [ 1274.696684] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.696838] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.696913] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.697144] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.697289] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.709868] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19062702-bd29-4477-a732-5169f347b4da in Status: IN_PROGRESS for 2s [ 1275.901222] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2515ad2c-fd11-420c-a9b5-5e230c52781f in Status: SUCCESS [ 1275.901554] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2515ad2c-fd11-420c-a9b5-5e230c52781f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.901605] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2515ad2c-fd11-420c-a9b5-5e230c52781f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.901875] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2515ad2c-fd11-420c-a9b5-5e230c52781f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.902126] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.902277] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.902364] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.902558] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.902674] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.902824] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2515ad2c-fd11-420c-a9b5-5e230c52781f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.902887] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2515ad2c-fd11-420c-a9b5-5e230c52781f',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.405683] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2515ad2c-fd11-420c-a9b5-5e230c52781f',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.533256] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e33b6cac-e9e7-4fe8-a87b-2dee2c42645e in Status: SUCCESS [ 1276.533453] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.533751] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.533958] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.534082] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e33b6cac-e9e7-4fe8-a87b-2dee2c42645e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.721587] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19062702-bd29-4477-a732-5169f347b4da in Status: SUCCESS [ 1276.721867] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.909319] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2515ad2c-fd11-420c-a9b5-5e230c52781f: rpc.has_security_group_logging(os_id): False [ 1276.926958] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.928047] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.928200] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.928445] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.928543] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.928889] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.929015] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.929087] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.929260] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.929340] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.929431] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2515ad2c-fd11-420c-a9b5-5e230c52781f is going to be created. [ 1276.991231] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.991421] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.991495] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.991643] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.991854] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.005132] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2515ad2c-fd11-420c-a9b5-5e230c52781f in Status: IN_PROGRESS for 2s [ 1277.037067] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.037067] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.037067] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.037365] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.038176] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.038176] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.038176] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.038176] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.038176] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.038176] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.038176] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e33b6cac-e9e7-4fe8-a87b-2dee2c42645e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.194152] env[70392]: INFO networking_nsxv3.common.synchronization [req-ea366c8d-6e92-4c3d-91db-ab1371d8f979 req-7b0d5a1d-bc33-470f-ac7b-da667f7410ce tempest-ServerMetadataTestJSON-2068834782 tempest-ServerMetadataTestJSON-2068834782-project-member] Enqueued Resource ID: 63340db4-2f8e-4cd1-a989-33f56aac8213 with Priority: HIGHEST for action security_group_members [ 1277.194690] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63340db4-2f8e-4cd1-a989-33f56aac8213 with Priority: HIGHEST for action security_group_members [ 1277.195079] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-63340db4-2f8e-4cd1-a989-33f56aac8213 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.195199] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63340db4-2f8e-4cd1-a989-33f56aac8213" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.195393] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63340db4-2f8e-4cd1-a989-33f56aac8213" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.195509] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63340db4-2f8e-4cd1-a989-33f56aac8213" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.195602] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.195684] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.195748] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.195892] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.195977] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.196965] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63340db4-2f8e-4cd1-a989-33f56aac8213',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.490401] env[70392]: INFO networking_nsxv3.common.synchronization [req-aa12c1fd-065f-4bfc-88a7-7aa4cb7987ad req-3a5ab482-5ebf-4646-a147-dc5962ae15bd tempest-ListServersNegativeTestJSON-1390298334 tempest-ListServersNegativeTestJSON-1390298334-project-member] Enqueued Resource ID: e33b6cac-e9e7-4fe8-a87b-2dee2c42645e with Priority: HIGHEST for action security_group_members [ 1277.494589] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e33b6cac-e9e7-4fe8-a87b-2dee2c42645e with Priority: HIGHEST for action security_group_members [ 1277.497220] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.497397] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.497483] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.497696] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.499376] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.500012] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.500012] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.500012] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.500012] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.500200] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e33b6cac-e9e7-4fe8-a87b-2dee2c42645e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.541505] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.541668] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.575261] env[70392]: INFO networking_nsxv3.common.synchronization [req-297d3f77-32e3-4beb-9485-db21cecd258f req-8bfd5307-6749-4be1-aff8-44e7793ba350 tempest-ListServersNegativeTestJSON-1390298334 tempest-ListServersNegativeTestJSON-1390298334-project-member] Enqueued Resource ID: e33b6cac-e9e7-4fe8-a87b-2dee2c42645e with Priority: HIGHEST for action security_group_members [ 1277.576087] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e33b6cac-e9e7-4fe8-a87b-2dee2c42645e with Priority: HIGHEST for action security_group_members [ 1277.576371] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.576465] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.701907] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.701907] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.701907] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.701907] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.701907] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.701907] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.701907] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.701907] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.701907] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.701907] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.701907] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63340db4-2f8e-4cd1-a989-33f56aac8213 is going to be updated. [ 1277.735390] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.735591] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.735591] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.736606] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.736606] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.745921] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63340db4-2f8e-4cd1-a989-33f56aac8213 in Status: IN_PROGRESS for 2s [ 1278.002072] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e33b6cac-e9e7-4fe8-a87b-2dee2c42645e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.504333] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e33b6cac-e9e7-4fe8-a87b-2dee2c42645e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.007166] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.007443] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.007443] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.007725] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.008466] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.008466] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e33b6cac-e9e7-4fe8-a87b-2dee2c42645e is going to be updated. [ 1279.020697] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2515ad2c-fd11-420c-a9b5-5e230c52781f in Status: SUCCESS [ 1279.020697] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2515ad2c-fd11-420c-a9b5-5e230c52781f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.041705] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.041928] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.041928] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.042186] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.042293] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.051339] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e33b6cac-e9e7-4fe8-a87b-2dee2c42645e in Status: IN_PROGRESS for 2s [ 1279.767941] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63340db4-2f8e-4cd1-a989-33f56aac8213 in Status: SUCCESS [ 1279.768151] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63340db4-2f8e-4cd1-a989-33f56aac8213 deletion is rescheduled due to dependency. [ 1279.768350] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63340db4-2f8e-4cd1-a989-33f56aac8213" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.065667] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e33b6cac-e9e7-4fe8-a87b-2dee2c42645e in Status: SUCCESS [ 1281.066033] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.066129] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.066370] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.066589] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.066956] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.067095] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.067292] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.067458] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.067504] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.067891] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.068024] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.068853] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.068853] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.068853] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.068853] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.068853] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.069136] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.069136] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.069196] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.070044] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e33b6cac-e9e7-4fe8-a87b-2dee2c42645e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.071351] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.071632] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.071823] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.071939] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.072013] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.072167] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.073032] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.073032] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e33b6cac-e9e7-4fe8-a87b-2dee2c42645e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.479245] env[70392]: INFO networking_nsxv3.common.synchronization [req-666b2567-f9e6-4400-a2cf-4569d377b679 req-c935ed05-6f5e-4f36-ad9c-b6ba4dde2560 tempest-ServerActionsTestOtherA-1411478130 tempest-ServerActionsTestOtherA-1411478130-project-member] Enqueued Resource ID: 47a435cb-d815-4f84-b215-41c82faf33b9 with Priority: HIGHEST for action security_group_members [ 1281.479790] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47a435cb-d815-4f84-b215-41c82faf33b9 with Priority: HIGHEST for action security_group_members [ 1281.480108] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-47a435cb-d815-4f84-b215-41c82faf33b9 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.480243] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.480308] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.480476] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.480620] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.480714] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.480779] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.480924] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.481012] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.481108] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47a435cb-d815-4f84-b215-41c82faf33b9',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.572230] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e33b6cac-e9e7-4fe8-a87b-2dee2c42645e: rpc.has_security_group_logging(os_id): False [ 1281.575175] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.575328] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.575402] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.575628] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.575725] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.575963] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.576084] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.576156] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.576818] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.576818] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.576818] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e33b6cac-e9e7-4fe8-a87b-2dee2c42645e is going to be updated. [ 1281.590338] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.590659] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.590860] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.591124] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.591223] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.591443] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.591572] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.591618] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.591767] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.591846] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.592042] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.592142] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.592204] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.592344] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.592415] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.592591] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.592678] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.593195] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.593195] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.593195] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.595284] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e33b6cac-e9e7-4fe8-a87b-2dee2c42645e is going to be updated. [ 1281.608909] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.609576] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.609761] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.610019] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.610213] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.622106] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e33b6cac-e9e7-4fe8-a87b-2dee2c42645e in Status: IN_PROGRESS for 2s [ 1281.668254] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.668457] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.668457] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.668730] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.668974] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.683090] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e33b6cac-e9e7-4fe8-a87b-2dee2c42645e in Status: IN_PROGRESS for 2s [ 1281.983930] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('47a435cb-d815-4f84-b215-41c82faf33b9',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.370983] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-844 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.371454] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-844" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.371527] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-844" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.371847] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-844" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.372092] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.372319] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.372492] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.372780] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.372973] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.373391] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1282.373456] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1282.373569] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1282.373715] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1282.373833] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1282.373958] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1282.374157] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1282.394630] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1282.394956] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1282.395234] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1282.395539] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-844" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.396657] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-89db0939-beb2-475c-8e8a-9f45e0599555 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.397885] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-89db0939-beb2-475c-8e8a-9f45e0599555" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.398588] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-89db0939-beb2-475c-8e8a-9f45e0599555" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.399014] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-89db0939-beb2-475c-8e8a-9f45e0599555" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.399280] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89db0939-beb2-475c-8e8a-9f45e0599555',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.486613] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('47a435cb-d815-4f84-b215-41c82faf33b9',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.902859] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.903050] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.903187] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.903471] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.903627] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.903934] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 89db0939-beb2-475c-8e8a-9f45e0599555 not found, creating... [ 1282.904108] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.904304] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.904859] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.904859] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.904859] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.905134] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.905306] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.905510] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.905645] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.905782] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.905946] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 89db0939-beb2-475c-8e8a-9f45e0599555 is going to be created. [ 1282.928291] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.928518] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.928654] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.929046] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.929324] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.929625] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-89db0939-beb2-475c-8e8a-9f45e0599555" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.989113] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.989279] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.989360] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.989579] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.989692] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.989823] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47a435cb-d815-4f84-b215-41c82faf33b9 is going to be updated. [ 1283.088782] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.088782] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.088782] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.088782] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.088782] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.096988] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47a435cb-d815-4f84-b215-41c82faf33b9 in Status: IN_PROGRESS for 2s [ 1283.633319] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e33b6cac-e9e7-4fe8-a87b-2dee2c42645e in Status: SUCCESS [ 1283.633319] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e33b6cac-e9e7-4fe8-a87b-2dee2c42645e deletion is rescheduled due to dependency. [ 1283.633319] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.655269] env[70392]: INFO networking_nsxv3.common.synchronization [req-666b2567-f9e6-4400-a2cf-4569d377b679 req-75992957-8bc4-4303-942c-9f070a7811a7 service nova] Enqueued Resource ID: 47a435cb-d815-4f84-b215-41c82faf33b9 with Priority: HIGHEST for action security_group_rules [ 1283.655928] env[70392]: INFO networking_nsxv3.common.synchronization [req-666b2567-f9e6-4400-a2cf-4569d377b679 req-75992957-8bc4-4303-942c-9f070a7811a7 service nova] Enqueued Resource ID: 47a435cb-d815-4f84-b215-41c82faf33b9 with Priority: HIGHEST for action security_group_members [ 1283.656364] env[70392]: INFO networking_nsxv3.common.synchronization [req-666b2567-f9e6-4400-a2cf-4569d377b679 req-75992957-8bc4-4303-942c-9f070a7811a7 service nova] Enqueued Resource ID: 89db0939-beb2-475c-8e8a-9f45e0599555 with Priority: HIGHEST for action port [ 1283.659023] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47a435cb-d815-4f84-b215-41c82faf33b9 with Priority: HIGHEST for action security_group_rules [ 1283.659170] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47a435cb-d815-4f84-b215-41c82faf33b9 with Priority: HIGHEST for action security_group_members [ 1283.664082] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89db0939-beb2-475c-8e8a-9f45e0599555 with Priority: HIGHEST for action port [ 1283.664082] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-47a435cb-d815-4f84-b215-41c82faf33b9 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.664082] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.664082] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.664082] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.664082] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('47a435cb-d815-4f84-b215-41c82faf33b9',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.664082] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-47a435cb-d815-4f84-b215-41c82faf33b9 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.664082] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.664082] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-89db0939-beb2-475c-8e8a-9f45e0599555 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.664082] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-89db0939-beb2-475c-8e8a-9f45e0599555" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.664082] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-89db0939-beb2-475c-8e8a-9f45e0599555" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.666225] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-89db0939-beb2-475c-8e8a-9f45e0599555" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.666464] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89db0939-beb2-475c-8e8a-9f45e0599555',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.698589] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e33b6cac-e9e7-4fe8-a87b-2dee2c42645e in Status: SUCCESS [ 1283.698994] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.170726] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-47a435cb-d815-4f84-b215-41c82faf33b9 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.170960] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.171219] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 89db0939-beb2-475c-8e8a-9f45e0599555 with status ACTIVE [ 1284.171395] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.172619] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.172619] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.172619] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.172619] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.172619] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.172619] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.172619] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.172619] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.172978] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.173250] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.173509] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.173509] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.173600] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.173691] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.173894] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 89db0939-beb2-475c-8e8a-9f45e0599555 is going to be updated. [ 1284.204025] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.204025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.204025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.204025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.204025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.204025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-89db0939-beb2-475c-8e8a-9f45e0599555" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.107112] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47a435cb-d815-4f84-b215-41c82faf33b9 in Status: SUCCESS [ 1285.107384] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.107509] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.107630] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.107788] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.107913] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.107997] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.108151] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.108203] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.108299] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47a435cb-d815-4f84-b215-41c82faf33b9',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.611087] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('47a435cb-d815-4f84-b215-41c82faf33b9',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1286.113841] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('47a435cb-d815-4f84-b215-41c82faf33b9',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1286.618494] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.618961] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.619080] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.619402] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.619481] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.619547] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47a435cb-d815-4f84-b215-41c82faf33b9 is going to be updated. [ 1286.657042] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.657042] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.657042] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.657276] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.657457] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.673990] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47a435cb-d815-4f84-b215-41c82faf33b9 in Status: IN_PROGRESS for 2s [ 1287.694333] env[70392]: INFO networking_nsxv3.common.synchronization [None req-0f0cb864-258d-404b-ab21-e15379f62772 None None] Enqueued Resource ID: 7322060a-72d6-4415-9a45-ee73c466ef83 with Priority: HIGHEST for action port [ 1287.694812] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7322060a-72d6-4415-9a45-ee73c466ef83 with Priority: HIGHEST for action port [ 1287.695350] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-7322060a-72d6-4415-9a45-ee73c466ef83 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.695516] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7322060a-72d6-4415-9a45-ee73c466ef83" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.695516] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7322060a-72d6-4415-9a45-ee73c466ef83" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.695693] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7322060a-72d6-4415-9a45-ee73c466ef83" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.695861] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7322060a-72d6-4415-9a45-ee73c466ef83',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.200700] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7322060a-72d6-4415-9a45-ee73c466ef83 [ 1288.200952] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.201290] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.201290] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.201553] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.201553] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.201553] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7322060a-72d6-4415-9a45-ee73c466ef83 already deleted. [ 1288.201658] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7322060a-72d6-4415-9a45-ee73c466ef83" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.688022] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47a435cb-d815-4f84-b215-41c82faf33b9 in Status: SUCCESS [ 1288.688215] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.688391] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.688663] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.689299] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.689299] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.689299] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.689299] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.689299] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.689299] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.689965] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('47a435cb-d815-4f84-b215-41c82faf33b9',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.153453] env[70392]: INFO networking_nsxv3.common.synchronization [req-18ec0ebc-1960-4bb3-bd64-ba2d4fb3bd18 req-890364d6-c2e9-47dc-9bc0-6ad644343b0d tempest-ServersTestJSON-507292717 tempest-ServersTestJSON-507292717-project-member] Enqueued Resource ID: 19062702-bd29-4477-a732-5169f347b4da with Priority: HIGHEST for action security_group_members [ 1289.154661] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19062702-bd29-4477-a732-5169f347b4da with Priority: HIGHEST for action security_group_members [ 1289.154661] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-19062702-bd29-4477-a732-5169f347b4da taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.154661] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.154661] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.154836] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.154872] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.154982] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.155037] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.155195] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.155274] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.155370] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.195569] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('47a435cb-d815-4f84-b215-41c82faf33b9',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.479548] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-219 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.479748] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-219" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.479947] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-219" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.480229] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-219" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.480489] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.480647] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.480768] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.480984] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.481170] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.481390] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1289.481509] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1289.481621] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1289.481730] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1289.481842] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1289.481952] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1289.482103] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1289.502505] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1289.502685] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1289.502824] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1289.503025] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-219" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.503334] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-750e1ccc-e2dd-4058-bec1-882e715a35bf taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.503508] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-750e1ccc-e2dd-4058-bec1-882e715a35bf" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.503630] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-750e1ccc-e2dd-4058-bec1-882e715a35bf" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.503965] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-750e1ccc-e2dd-4058-bec1-882e715a35bf" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.504130] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('750e1ccc-e2dd-4058-bec1-882e715a35bf',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.661304] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.697712] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 47a435cb-d815-4f84-b215-41c82faf33b9: rpc.has_security_group_logging(os_id): False [ 1289.716598] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.716893] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.717000] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.717242] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.717340] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.717597] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.717885] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.717885] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.717997] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.717997] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.718108] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 47a435cb-d815-4f84-b215-41c82faf33b9 is going to be updated. [ 1289.781622] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.781868] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.781967] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.782202] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.782375] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.797240] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 47a435cb-d815-4f84-b215-41c82faf33b9 in Status: IN_PROGRESS for 2s [ 1290.006296] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.006530] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.006662] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.007073] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.007251] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.007418] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 750e1ccc-e2dd-4058-bec1-882e715a35bf not found, creating... [ 1290.007683] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.007845] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.007976] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.008274] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.008363] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.008648] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.008834] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.009140] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.009393] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.009545] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.009698] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 750e1ccc-e2dd-4058-bec1-882e715a35bf is going to be created. [ 1290.030013] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.030237] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.030346] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.030623] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.030863] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.031123] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-750e1ccc-e2dd-4058-bec1-882e715a35bf" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.164445] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.300842] env[70392]: INFO networking_nsxv3.common.synchronization [None req-a5d3fbba-0259-4325-9744-b17110a6d506 None None] Enqueued Resource ID: d1e612ec-b6fe-4ced-8e26-0225a90e2b83 with Priority: HIGHEST for action port [ 1290.301638] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1e612ec-b6fe-4ced-8e26-0225a90e2b83 with Priority: HIGHEST for action port [ 1290.301960] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-d1e612ec-b6fe-4ced-8e26-0225a90e2b83 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.302265] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d1e612ec-b6fe-4ced-8e26-0225a90e2b83" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.302265] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d1e612ec-b6fe-4ced-8e26-0225a90e2b83" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.302423] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d1e612ec-b6fe-4ced-8e26-0225a90e2b83" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.302535] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d1e612ec-b6fe-4ced-8e26-0225a90e2b83',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.667431] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.668809] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.668809] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.668809] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.668809] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.668809] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19062702-bd29-4477-a732-5169f347b4da is going to be updated. [ 1290.696551] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.696551] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.696551] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.696551] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.696881] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.705970] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19062702-bd29-4477-a732-5169f347b4da in Status: IN_PROGRESS for 2s [ 1290.751125] env[70392]: INFO networking_nsxv3.common.synchronization [req-18ec0ebc-1960-4bb3-bd64-ba2d4fb3bd18 req-7863b874-7068-4871-a425-566ef008e36a service nova] Enqueued Resource ID: 19062702-bd29-4477-a732-5169f347b4da with Priority: HIGHEST for action security_group_rules [ 1290.751323] env[70392]: INFO networking_nsxv3.common.synchronization [req-18ec0ebc-1960-4bb3-bd64-ba2d4fb3bd18 req-7863b874-7068-4871-a425-566ef008e36a service nova] Enqueued Resource ID: 19062702-bd29-4477-a732-5169f347b4da with Priority: HIGHEST for action security_group_members [ 1290.751463] env[70392]: INFO networking_nsxv3.common.synchronization [req-18ec0ebc-1960-4bb3-bd64-ba2d4fb3bd18 req-7863b874-7068-4871-a425-566ef008e36a service nova] Enqueued Resource ID: 750e1ccc-e2dd-4058-bec1-882e715a35bf with Priority: HIGHEST for action port [ 1290.751719] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19062702-bd29-4477-a732-5169f347b4da with Priority: HIGHEST for action security_group_rules [ 1290.751913] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19062702-bd29-4477-a732-5169f347b4da with Priority: HIGHEST for action security_group_members [ 1290.752068] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 750e1ccc-e2dd-4058-bec1-882e715a35bf with Priority: HIGHEST for action port [ 1290.752702] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-19062702-bd29-4477-a732-5169f347b4da taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.752828] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.752897] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.755199] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.755300] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.756219] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-19062702-bd29-4477-a732-5169f347b4da taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.756320] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.756517] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-750e1ccc-e2dd-4058-bec1-882e715a35bf taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.756621] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-750e1ccc-e2dd-4058-bec1-882e715a35bf" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.756718] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-750e1ccc-e2dd-4058-bec1-882e715a35bf" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.756902] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-750e1ccc-e2dd-4058-bec1-882e715a35bf" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.757145] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('750e1ccc-e2dd-4058-bec1-882e715a35bf',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.804956] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d1e612ec-b6fe-4ced-8e26-0225a90e2b83 [ 1290.804956] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.804956] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.804956] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.805292] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.805292] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.805402] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d1e612ec-b6fe-4ced-8e26-0225a90e2b83 already deleted. [ 1290.805520] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d1e612ec-b6fe-4ced-8e26-0225a90e2b83" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.259531] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-19062702-bd29-4477-a732-5169f347b4da taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.259882] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.259926] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 750e1ccc-e2dd-4058-bec1-882e715a35bf with status ACTIVE [ 1291.260192] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.260353] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.260448] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.260729] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.260855] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.261126] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.261264] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.261350] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.261664] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.261722] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.261967] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.262133] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.262227] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.262434] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.262550] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.262680] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 750e1ccc-e2dd-4058-bec1-882e715a35bf is going to be updated. [ 1291.289316] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.289316] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.289316] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.289658] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.289831] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.290155] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-750e1ccc-e2dd-4058-bec1-882e715a35bf" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.811265] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 47a435cb-d815-4f84-b215-41c82faf33b9 in Status: SUCCESS [ 1291.811631] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.717773] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19062702-bd29-4477-a732-5169f347b4da in Status: SUCCESS [ 1292.718224] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.718293] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.718519] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.718748] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.718902] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.718971] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.719231] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.719341] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.719443] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.222333] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.332331] env[70392]: INFO networking_nsxv3.common.synchronization [req-01454621-5dfb-4e25-8b29-81b0adc176e5 req-a7420047-0e5c-4790-91c1-05d6ecc7a978 tempest-ServerMetadataNegativeTestJSON-97596033 tempest-ServerMetadataNegativeTestJSON-97596033-project-member] Enqueued Resource ID: 0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f with Priority: HIGHEST for action security_group_members [ 1293.333539] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f with Priority: HIGHEST for action security_group_members [ 1293.333852] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.334026] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.334093] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.334318] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.334481] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.334634] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.334726] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.334892] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.334980] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.335092] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.634292] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-423 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.634610] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-423" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.634803] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-423" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.635212] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-423" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.635994] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.636263] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.636521] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.636861] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.636997] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.637320] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1293.637499] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1293.637716] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1293.637882] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1293.638118] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1293.638328] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1293.638570] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1293.662293] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1293.662454] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1293.662596] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1293.662782] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-423" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.663154] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-2440e8c3-d8bf-45f4-ab12-e4f93158069b taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.663395] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-2440e8c3-d8bf-45f4-ab12-e4f93158069b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.663469] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-2440e8c3-d8bf-45f4-ab12-e4f93158069b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.663998] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-2440e8c3-d8bf-45f4-ab12-e4f93158069b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.664163] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2440e8c3-d8bf-45f4-ab12-e4f93158069b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.726744] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.839494] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.839494] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.839728] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.839769] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.840476] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.840476] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.840476] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.840476] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.840476] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.840877] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.840877] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f already deleted. [ 1293.840877] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.166554] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.166554] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.166834] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.167042] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.167279] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.167432] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 2440e8c3-d8bf-45f4-ab12-e4f93158069b not found, creating... [ 1294.168162] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.168162] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.168162] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.168451] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.168451] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.168770] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.169015] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.169214] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.169521] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.169709] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.169941] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 2440e8c3-d8bf-45f4-ab12-e4f93158069b is going to be created. [ 1294.190861] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.191191] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.191392] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.191634] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.191874] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.192164] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-2440e8c3-d8bf-45f4-ab12-e4f93158069b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.229588] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.229664] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.229707] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.230061] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.230195] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.230350] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19062702-bd29-4477-a732-5169f347b4da is going to be updated. [ 1294.265675] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.265881] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.265929] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.266151] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.266348] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.276712] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19062702-bd29-4477-a732-5169f347b4da in Status: IN_PROGRESS for 2s [ 1295.428523] env[70392]: INFO networking_nsxv3.common.synchronization [req-01454621-5dfb-4e25-8b29-81b0adc176e5 req-f6c867fa-5274-4989-ba17-9108c8a93bb0 service nova] Enqueued Resource ID: 0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f with Priority: HIGHEST for action security_group_rules [ 1295.428792] env[70392]: INFO networking_nsxv3.common.synchronization [req-01454621-5dfb-4e25-8b29-81b0adc176e5 req-f6c867fa-5274-4989-ba17-9108c8a93bb0 service nova] Enqueued Resource ID: 0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f with Priority: HIGHEST for action security_group_members [ 1295.428860] env[70392]: INFO networking_nsxv3.common.synchronization [req-01454621-5dfb-4e25-8b29-81b0adc176e5 req-f6c867fa-5274-4989-ba17-9108c8a93bb0 service nova] Enqueued Resource ID: 2440e8c3-d8bf-45f4-ab12-e4f93158069b with Priority: HIGHEST for action port [ 1295.429173] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f with Priority: HIGHEST for action security_group_rules [ 1295.429325] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f with Priority: HIGHEST for action security_group_members [ 1295.429442] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2440e8c3-d8bf-45f4-ab12-e4f93158069b with Priority: HIGHEST for action port [ 1295.430032] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.430213] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.430281] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.430558] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.430645] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.431901] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.432012] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.432055] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.432227] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.432370] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.432463] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.432520] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.432662] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.432744] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.432830] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.433591] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-2440e8c3-d8bf-45f4-ab12-e4f93158069b taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.433694] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2440e8c3-d8bf-45f4-ab12-e4f93158069b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.433763] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2440e8c3-d8bf-45f4-ab12-e4f93158069b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.435682] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2440e8c3-d8bf-45f4-ab12-e4f93158069b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.435761] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2440e8c3-d8bf-45f4-ab12-e4f93158069b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.938549] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.939674] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.939833] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.939959] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2440e8c3-d8bf-45f4-ab12-e4f93158069b with status ACTIVE [ 1295.940123] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.940416] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.940416] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.940569] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.940569] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.940754] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.940851] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.940920] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.941081] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.941160] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.946581] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.946581] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.946581] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.946581] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.946581] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.946581] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2440e8c3-d8bf-45f4-ab12-e4f93158069b is going to be updated. [ 1295.969430] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.969591] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.969636] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.969822] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.969956] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.970142] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2440e8c3-d8bf-45f4-ab12-e4f93158069b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.287477] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19062702-bd29-4477-a732-5169f347b4da in Status: SUCCESS [ 1296.287477] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.287477] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.287477] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.287477] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.287861] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.287861] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.287861] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.287861] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.288043] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.288043] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.446079] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.790847] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-19062702-bd29-4477-a732-5169f347b4da taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.791045] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.791127] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.791440] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.791644] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.791757] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.791826] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.791990] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.792091] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.792180] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.792325] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-19062702-bd29-4477-a732-5169f347b4da taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.792418] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.792480] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.792623] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.792758] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.792848] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.792910] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.793057] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.793133] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.793214] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.793302] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.948870] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.949124] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.949198] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.949404] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.949493] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.949603] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f is going to be created. [ 1296.972610] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.972824] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.972824] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.973079] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.973210] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.982321] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f in Status: UNINITIALIZED for 2s [ 1297.296093] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 19062702-bd29-4477-a732-5169f347b4da: rpc.has_security_group_logging(os_id): False [ 1297.314341] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.314498] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.314598] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.314763] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.314945] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.315131] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.315236] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.315309] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.315479] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.315527] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.315694] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.315803] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.315871] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.316018] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.316115] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.316296] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.316387] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.316454] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.316588] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.316671] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.316759] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 19062702-bd29-4477-a732-5169f347b4da is going to be updated. [ 1297.383738] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.383738] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.383738] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.384027] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.384883] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.400621] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 19062702-bd29-4477-a732-5169f347b4da in Status: IN_PROGRESS for 2s [ 1298.993888] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f in Status: SUCCESS [ 1298.994447] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.994447] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.994624] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.994761] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.994887] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.994956] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.995141] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.995218] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.995321] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.995397] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.413078] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 19062702-bd29-4477-a732-5169f347b4da in Status: SUCCESS [ 1299.413314] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.498193] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.498374] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.498455] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.498645] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.498820] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.498920] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.498980] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.499238] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.499329] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.499419] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.499584] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.499678] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.499732] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.500105] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.500267] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.500357] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.500425] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.500562] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.500638] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.500719] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.500810] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.003125] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f: rpc.has_security_group_logging(os_id): False [ 1300.022803] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.023121] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.023121] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.023287] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.023355] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.023564] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.023715] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.023715] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.023868] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.023945] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.024195] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.024312] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.024312] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.024463] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.024528] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.024730] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.024842] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.024903] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.025056] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.025184] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.025299] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f is going to be created. [ 1300.109822] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.110484] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.110484] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.110484] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.110644] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.126946] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f in Status: IN_PROGRESS for 2s [ 1300.421829] env[70392]: INFO networking_nsxv3.common.synchronization [req-ec272af4-f93d-42e1-953d-6df3847c3762 req-f9b3c29e-f7af-4f98-8751-63248dd4932c tempest-AttachVolumeNegativeTest-772339566 tempest-AttachVolumeNegativeTest-772339566-project-member] Enqueued Resource ID: 2e375ce9-a326-43ce-b62b-e40b371dfd91 with Priority: HIGHEST for action security_group_members [ 1300.422565] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e375ce9-a326-43ce-b62b-e40b371dfd91 with Priority: HIGHEST for action security_group_members [ 1300.422968] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e375ce9-a326-43ce-b62b-e40b371dfd91 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.423138] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e375ce9-a326-43ce-b62b-e40b371dfd91" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.423210] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e375ce9-a326-43ce-b62b-e40b371dfd91" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.423416] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e375ce9-a326-43ce-b62b-e40b371dfd91" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.425049] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.425049] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.425049] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.425049] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.425049] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.425049] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e375ce9-a326-43ce-b62b-e40b371dfd91',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.926947] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.927936] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.927936] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.927936] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.927936] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.927936] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.928299] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.928299] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.928390] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.928452] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.928548] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e375ce9-a326-43ce-b62b-e40b371dfd91 is going to be updated. [ 1300.965866] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.966030] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.966102] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.966338] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.966485] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.978451] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e375ce9-a326-43ce-b62b-e40b371dfd91 in Status: IN_PROGRESS for 2s [ 1302.143571] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f in Status: SUCCESS [ 1302.143978] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.835972] env[70392]: INFO networking_nsxv3.common.synchronization [req-eb2f5268-39d1-4a7e-b2da-03df7932f5a9 req-b1c67d66-2751-4511-9101-64708accb6c0 tempest-ServersTestJSON-507292717 tempest-ServersTestJSON-507292717-project-member] Enqueued Resource ID: 19062702-bd29-4477-a732-5169f347b4da with Priority: HIGHEST for action security_group_members [ 1302.836602] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19062702-bd29-4477-a732-5169f347b4da with Priority: HIGHEST for action security_group_members [ 1302.836930] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-19062702-bd29-4477-a732-5169f347b4da taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.837095] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.837196] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.837405] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.837606] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.837734] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.837815] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.837932] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.838021] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.838125] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.987969] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e375ce9-a326-43ce-b62b-e40b371dfd91 in Status: SUCCESS [ 1302.988276] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e375ce9-a326-43ce-b62b-e40b371dfd91 deletion is rescheduled due to dependency. [ 1302.988420] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e375ce9-a326-43ce-b62b-e40b371dfd91" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.340843] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.843420] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.347083] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.347083] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.347083] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.347083] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.347083] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.347083] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19062702-bd29-4477-a732-5169f347b4da is going to be updated. [ 1304.377130] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.377309] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.377359] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.377546] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.377680] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.386797] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19062702-bd29-4477-a732-5169f347b4da in Status: IN_PROGRESS for 2s [ 1306.399712] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19062702-bd29-4477-a732-5169f347b4da in Status: SUCCESS [ 1306.400049] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.144907] env[70392]: INFO networking_nsxv3.common.synchronization [req-512e4da2-7e10-460d-83b6-5ef69ca8d830 req-74d0fe97-c905-43a1-a212-4bbc2d4946e5 tempest-ServerMetadataNegativeTestJSON-97596033 tempest-ServerMetadataNegativeTestJSON-97596033-project-member] Enqueued Resource ID: 0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f with Priority: HIGHEST for action security_group_members [ 1307.145450] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f with Priority: HIGHEST for action security_group_members [ 1307.146041] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.146041] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.146041] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.146265] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.146332] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.146429] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.146486] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.146637] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.146740] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.146858] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.648853] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.649202] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.649202] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.649400] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.649495] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.649696] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.649792] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.649842] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.650042] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.650137] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.650226] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f is going to be updated. [ 1307.678447] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.678586] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.678657] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.678868] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.679041] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.689896] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f in Status: IN_PROGRESS for 2s [ 1309.702890] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f in Status: SUCCESS [ 1309.703243] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f deletion is rescheduled due to dependency. [ 1309.703243] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.576556] env[70392]: INFO networking_nsxv3.common.synchronization [req-48883cb2-b2bb-4a7d-9921-1a31fe1f52e7 req-c1bacd23-5a4b-4e41-8a0a-83b4de8541b1 tempest-ServersTestJSON-507292717 tempest-ServersTestJSON-507292717-project-member] Enqueued Resource ID: 19062702-bd29-4477-a732-5169f347b4da with Priority: HIGHEST for action security_group_members [ 1310.577042] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19062702-bd29-4477-a732-5169f347b4da with Priority: HIGHEST for action security_group_members [ 1310.577751] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-19062702-bd29-4477-a732-5169f347b4da taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.577751] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.577751] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.577918] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.578360] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.578513] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.578802] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.579031] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.579086] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.579183] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.081572] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.082018] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.082018] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.082018] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.082136] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.082300] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.082395] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.082457] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.082605] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.082685] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.082769] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19062702-bd29-4477-a732-5169f347b4da is going to be updated. [ 1311.114351] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.114538] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.114609] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.114766] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.114904] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.125854] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19062702-bd29-4477-a732-5169f347b4da in Status: IN_PROGRESS for 2s [ 1313.138330] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19062702-bd29-4477-a732-5169f347b4da in Status: IN_PROGRESS for 4s [ 1315.151870] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19062702-bd29-4477-a732-5169f347b4da in Status: SUCCESS [ 1315.152246] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19062702-bd29-4477-a732-5169f347b4da deletion is rescheduled due to dependency. [ 1315.152429] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.580879] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1315.580879] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1315.983480] env[70392]: INFO networking_nsxv3.common.synchronization [req-d9be1227-ad4c-49ed-9997-1ad5934e6bff req-cc14e55a-ac00-4446-bf49-51a63ddb59fa tempest-ServerActionsTestOtherB-779604050 tempest-ServerActionsTestOtherB-779604050-project-member] Enqueued Resource ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 with Priority: HIGHEST for action security_group_members [ 1315.984445] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 with Priority: HIGHEST for action security_group_members [ 1315.984621] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.984742] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.984805] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.984999] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.985794] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.985947] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.986031] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.987028] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.987312] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.987462] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.489647] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.492028] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.492028] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.492028] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.492028] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.492028] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.492028] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.492028] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.492028] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.492028] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.492028] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 is going to be updated. [ 1316.538328] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.538533] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.538533] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.538718] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.538871] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.548298] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 in Status: IN_PROGRESS for 2s [ 1318.561683] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 in Status: SUCCESS [ 1318.562050] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 deletion is rescheduled due to dependency. [ 1318.562050] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.985250] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1320.985495] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1324.897930] env[70392]: INFO networking_nsxv3.common.synchronization [req-27511e9c-0ebe-42a3-97cf-590cb9465f85 req-bf9b1256-6457-48c8-b8c7-425ab99e8b5c tempest-ServerActionsTestOtherB-779604050 tempest-ServerActionsTestOtherB-779604050-project-member] Enqueued Resource ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 with Priority: HIGHEST for action security_group_members [ 1324.898870] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 with Priority: HIGHEST for action security_group_members [ 1324.899305] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.899492] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.899797] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.900143] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.900329] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.900441] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.900544] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.900683] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.900771] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.900867] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.221672] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-452 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.222452] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-452" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.222597] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-452" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.222873] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-452" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.223162] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.223367] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.223539] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.223792] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.223944] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.224194] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1325.224320] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1325.224479] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1325.224601] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1325.224718] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1325.224828] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1325.224960] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1325.245290] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1325.245555] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1325.245679] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1325.245866] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-452" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.246197] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-4efb56b8-aac1-4900-9115-6bb4d3344aba taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.246375] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-4efb56b8-aac1-4900-9115-6bb4d3344aba" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.246498] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-4efb56b8-aac1-4900-9115-6bb4d3344aba" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.246851] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-4efb56b8-aac1-4900-9115-6bb4d3344aba" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.247210] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4efb56b8-aac1-4900-9115-6bb4d3344aba',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.404926] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.405152] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.405231] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.405452] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.405548] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.405796] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.405900] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.405963] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.406159] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.406256] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.406364] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 is going to be updated. [ 1325.433021] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.433216] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.433264] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.433462] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.433611] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.442558] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 in Status: IN_PROGRESS for 2s [ 1325.750229] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.750505] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.750505] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.750720] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.750885] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.751094] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 4efb56b8-aac1-4900-9115-6bb4d3344aba not found, creating... [ 1325.751376] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.751545] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.751667] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.751912] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.752067] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.752357] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.752558] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.752693] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.752912] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.753063] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.753211] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 4efb56b8-aac1-4900-9115-6bb4d3344aba is going to be created. [ 1325.775190] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.775414] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.775414] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.775851] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.775999] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.776247] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-4efb56b8-aac1-4900-9115-6bb4d3344aba" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.470653] env[70392]: INFO networking_nsxv3.common.synchronization [req-27511e9c-0ebe-42a3-97cf-590cb9465f85 req-24029d5f-e23a-4394-804e-2a3076d42c87 service nova] Enqueued Resource ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 with Priority: HIGHEST for action security_group_rules [ 1326.470954] env[70392]: INFO networking_nsxv3.common.synchronization [req-27511e9c-0ebe-42a3-97cf-590cb9465f85 req-24029d5f-e23a-4394-804e-2a3076d42c87 service nova] Enqueued Resource ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 with Priority: HIGHEST for action security_group_members [ 1326.470994] env[70392]: INFO networking_nsxv3.common.synchronization [req-27511e9c-0ebe-42a3-97cf-590cb9465f85 req-24029d5f-e23a-4394-804e-2a3076d42c87 service nova] Enqueued Resource ID: 4efb56b8-aac1-4900-9115-6bb4d3344aba with Priority: HIGHEST for action port [ 1326.471239] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 with Priority: HIGHEST for action security_group_rules [ 1326.471370] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 with Priority: HIGHEST for action security_group_members [ 1326.471466] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4efb56b8-aac1-4900-9115-6bb4d3344aba with Priority: HIGHEST for action port [ 1326.472182] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.472369] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.472403] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.472595] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.472691] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1326.474175] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.474416] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.474646] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-4efb56b8-aac1-4900-9115-6bb4d3344aba taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.474751] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4efb56b8-aac1-4900-9115-6bb4d3344aba" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.474837] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4efb56b8-aac1-4900-9115-6bb4d3344aba" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.474986] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4efb56b8-aac1-4900-9115-6bb4d3344aba" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.475075] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4efb56b8-aac1-4900-9115-6bb4d3344aba',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1326.975337] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.975562] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.977954] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4efb56b8-aac1-4900-9115-6bb4d3344aba with status ACTIVE [ 1326.978245] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.978408] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.978480] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.978701] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.978836] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.979016] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.979124] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.979186] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.979594] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.979594] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.979714] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.979847] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.979918] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.980093] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.980207] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.980303] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4efb56b8-aac1-4900-9115-6bb4d3344aba is going to be updated. [ 1327.004085] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.004360] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.004468] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.004656] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.004829] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.005054] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4efb56b8-aac1-4900-9115-6bb4d3344aba" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.452872] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 in Status: SUCCESS [ 1327.453155] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 deletion is rescheduled due to dependency. [ 1327.453256] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.453390] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.453698] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.453897] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.454083] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.454186] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.454415] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.454545] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.454694] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.957633] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.460979] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.964232] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.964754] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.964754] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.964754] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.964754] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.964981] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 is going to be updated. [ 1328.995824] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.996014] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.996060] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.996257] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.996402] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.005058] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 in Status: IN_PROGRESS for 2s [ 1331.016926] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 in Status: SUCCESS [ 1331.017309] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.017309] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.017541] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.017805] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.017939] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.017939] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.018117] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.018194] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.018290] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.018380] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.472646] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1331.472889] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1331.520387] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.022951] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5: rpc.has_security_group_logging(os_id): False [ 1332.041233] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.041469] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.041469] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.041669] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.041736] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.042015] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.042166] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.042166] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.042283] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.042330] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.042417] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 is going to be updated. [ 1332.103214] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.103430] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.103487] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.103728] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.103883] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.117401] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 in Status: IN_PROGRESS for 2s [ 1334.132068] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 in Status: SUCCESS [ 1334.132469] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.473559] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1336.473559] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1337.629311] env[70392]: INFO networking_nsxv3.common.synchronization [None req-9366bad9-43a7-4323-a17b-4f8b1678fe58 tempest-ServerActionsTestJSON-648729814 tempest-ServerActionsTestJSON-648729814-project-member] Enqueued Resource ID: 95c32541-66a7-4f87-ab53-411ea5d5172e with Priority: HIGHEST for action security_group_rules [ 1337.629892] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95c32541-66a7-4f87-ab53-411ea5d5172e with Priority: HIGHEST for action security_group_rules [ 1337.630226] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-95c32541-66a7-4f87-ab53-411ea5d5172e taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.630393] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-95c32541-66a7-4f87-ab53-411ea5d5172e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.630445] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-95c32541-66a7-4f87-ab53-411ea5d5172e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.630720] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-95c32541-66a7-4f87-ab53-411ea5d5172e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.630771] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('95c32541-66a7-4f87-ab53-411ea5d5172e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1337.718339] env[70392]: INFO networking_nsxv3.common.synchronization [None req-4660003d-16b2-4f6f-85bd-8b237481f805 tempest-ServerActionsTestJSON-648729814 tempest-ServerActionsTestJSON-648729814-project-member] Enqueued Resource ID: 95c32541-66a7-4f87-ab53-411ea5d5172e with Priority: HIGHEST for action security_group_rules [ 1337.718780] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95c32541-66a7-4f87-ab53-411ea5d5172e with Priority: HIGHEST for action security_group_rules [ 1337.719104] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-95c32541-66a7-4f87-ab53-411ea5d5172e taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.719217] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-95c32541-66a7-4f87-ab53-411ea5d5172e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.152661] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.152809] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.153053] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.153304] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.153609] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.153609] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 95c32541-66a7-4f87-ab53-411ea5d5172e already deleted. [ 1338.153609] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-95c32541-66a7-4f87-ab53-411ea5d5172e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.153718] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-95c32541-66a7-4f87-ab53-411ea5d5172e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.153868] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-95c32541-66a7-4f87-ab53-411ea5d5172e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.153952] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('95c32541-66a7-4f87-ab53-411ea5d5172e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1338.675384] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.675728] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.675728] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.675884] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.675943] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.676017] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 95c32541-66a7-4f87-ab53-411ea5d5172e already deleted. [ 1338.676104] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-95c32541-66a7-4f87-ab53-411ea5d5172e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.719598] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1342.720032] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1342.996374] env[70392]: INFO networking_nsxv3.common.synchronization [req-74a20df4-efb4-4b92-96ab-a6682a407e30 req-40ca103f-dfc7-402c-bcf8-f92054ce34e7 tempest-ServerActionsTestJSON-648729814 tempest-ServerActionsTestJSON-648729814-project-member] Enqueued Resource ID: 95c32541-66a7-4f87-ab53-411ea5d5172e with Priority: HIGHEST for action security_group_members [ 1342.996816] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95c32541-66a7-4f87-ab53-411ea5d5172e with Priority: HIGHEST for action security_group_members [ 1342.997218] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-95c32541-66a7-4f87-ab53-411ea5d5172e taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.997321] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95c32541-66a7-4f87-ab53-411ea5d5172e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.997429] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95c32541-66a7-4f87-ab53-411ea5d5172e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.997763] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95c32541-66a7-4f87-ab53-411ea5d5172e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.998014] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.998163] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.998288] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.998410] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.998648] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.998648] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('95c32541-66a7-4f87-ab53-411ea5d5172e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.274855] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-872 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.275135] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-872" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.275259] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-872" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.275525] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-872" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.275789] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.275955] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.276094] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.276315] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.276467] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.276708] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1343.276823] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1343.276942] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1343.277075] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1343.277195] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1343.277309] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1343.277447] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1343.304894] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1343.305116] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1343.305247] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1343.305504] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-872" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.305759] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-1f2bba77-4cc0-4ccc-87a2-66fe04ef0da4 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.305937] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-1f2bba77-4cc0-4ccc-87a2-66fe04ef0da4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.306128] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-1f2bba77-4cc0-4ccc-87a2-66fe04ef0da4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.306560] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-1f2bba77-4cc0-4ccc-87a2-66fe04ef0da4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.306757] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f2bba77-4cc0-4ccc-87a2-66fe04ef0da4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.501105] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.501365] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.501420] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.501635] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.501786] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.501971] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.502103] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.502172] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.502355] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.502598] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.502598] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95c32541-66a7-4f87-ab53-411ea5d5172e already deleted. [ 1343.502705] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95c32541-66a7-4f87-ab53-411ea5d5172e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.810105] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.810105] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.810509] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.810509] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.810644] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.810805] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 1f2bba77-4cc0-4ccc-87a2-66fe04ef0da4 not found, creating... [ 1343.811139] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.811313] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.811439] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.811667] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.811812] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.812108] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.812272] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.812397] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.812606] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.812747] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.812892] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 1f2bba77-4cc0-4ccc-87a2-66fe04ef0da4 is going to be created. [ 1343.834527] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.834726] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.834841] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.835102] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.835343] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.835569] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-1f2bba77-4cc0-4ccc-87a2-66fe04ef0da4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.514278] env[70392]: INFO networking_nsxv3.common.synchronization [req-74a20df4-efb4-4b92-96ab-a6682a407e30 req-d2eea591-9f54-4e3f-87a1-691b4b8a22c7 service nova] Enqueued Resource ID: 95c32541-66a7-4f87-ab53-411ea5d5172e with Priority: HIGHEST for action security_group_rules [ 1344.514278] env[70392]: INFO networking_nsxv3.common.synchronization [req-74a20df4-efb4-4b92-96ab-a6682a407e30 req-d2eea591-9f54-4e3f-87a1-691b4b8a22c7 service nova] Enqueued Resource ID: 95c32541-66a7-4f87-ab53-411ea5d5172e with Priority: HIGHEST for action security_group_members [ 1344.514278] env[70392]: INFO networking_nsxv3.common.synchronization [req-74a20df4-efb4-4b92-96ab-a6682a407e30 req-d2eea591-9f54-4e3f-87a1-691b4b8a22c7 service nova] Enqueued Resource ID: 1f2bba77-4cc0-4ccc-87a2-66fe04ef0da4 with Priority: HIGHEST for action port [ 1344.514278] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95c32541-66a7-4f87-ab53-411ea5d5172e with Priority: HIGHEST for action security_group_rules [ 1344.514278] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95c32541-66a7-4f87-ab53-411ea5d5172e with Priority: HIGHEST for action security_group_members [ 1344.514278] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f2bba77-4cc0-4ccc-87a2-66fe04ef0da4 with Priority: HIGHEST for action port [ 1344.514278] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-95c32541-66a7-4f87-ab53-411ea5d5172e taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.514607] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-95c32541-66a7-4f87-ab53-411ea5d5172e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.514766] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-95c32541-66a7-4f87-ab53-411ea5d5172e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.515058] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-95c32541-66a7-4f87-ab53-411ea5d5172e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.515232] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('95c32541-66a7-4f87-ab53-411ea5d5172e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.516224] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-95c32541-66a7-4f87-ab53-411ea5d5172e taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.516587] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95c32541-66a7-4f87-ab53-411ea5d5172e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.516851] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95c32541-66a7-4f87-ab53-411ea5d5172e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.517139] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95c32541-66a7-4f87-ab53-411ea5d5172e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.517384] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.517616] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.517777] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.518960] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.518960] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.518960] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('95c32541-66a7-4f87-ab53-411ea5d5172e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.519972] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-1f2bba77-4cc0-4ccc-87a2-66fe04ef0da4 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.520293] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1f2bba77-4cc0-4ccc-87a2-66fe04ef0da4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.520504] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1f2bba77-4cc0-4ccc-87a2-66fe04ef0da4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.520838] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1f2bba77-4cc0-4ccc-87a2-66fe04ef0da4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.521103] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f2bba77-4cc0-4ccc-87a2-66fe04ef0da4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.021425] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('95c32541-66a7-4f87-ab53-411ea5d5172e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.022796] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-95c32541-66a7-4f87-ab53-411ea5d5172e taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.022899] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95c32541-66a7-4f87-ab53-411ea5d5172e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.024217] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1f2bba77-4cc0-4ccc-87a2-66fe04ef0da4 with status ACTIVE [ 1345.024370] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.024485] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.024548] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.024747] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.024837] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.025022] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.025150] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.025193] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.025323] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.025400] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.025582] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.025671] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.025726] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.025863] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.025941] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.026039] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1f2bba77-4cc0-4ccc-87a2-66fe04ef0da4 is going to be updated. [ 1345.048613] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.048822] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.048822] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.049011] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.049156] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.049307] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1f2bba77-4cc0-4ccc-87a2-66fe04ef0da4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.523093] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('95c32541-66a7-4f87-ab53-411ea5d5172e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.663568] env[70392]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1345.663714] env[70392]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] NSXv3 Agent Agent loop - iteration:3 started [ 1345.743387] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-109 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.743564] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-109" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.743694] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-109" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.743968] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-109" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.744243] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.744407] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.744905] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.744905] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.744905] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.745092] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1345.745214] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1345.745329] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1345.745442] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1345.745557] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1345.745685] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1345.745826] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1345.764207] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1345.764375] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1345.764517] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1345.764698] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-109" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.765013] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-347e97f8-125e-4175-ad89-8fdf1e9adc77 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.765194] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-347e97f8-125e-4175-ad89-8fdf1e9adc77" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.765319] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-347e97f8-125e-4175-ad89-8fdf1e9adc77" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.765579] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-347e97f8-125e-4175-ad89-8fdf1e9adc77" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.765721] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('347e97f8-125e-4175-ad89-8fdf1e9adc77',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1346.025231] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.025605] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.025605] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.025688] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.025741] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.025839] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95c32541-66a7-4f87-ab53-411ea5d5172e is going to be created. [ 1346.050175] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.050375] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.050445] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.050658] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.050817] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.060806] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95c32541-66a7-4f87-ab53-411ea5d5172e in Status: UNINITIALIZED for 2s [ 1346.268215] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.268464] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.268600] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.268896] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.269099] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.269422] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.269591] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.269779] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.269997] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.270163] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.270437] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.270599] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.270720] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.270935] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.271098] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.271242] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 347e97f8-125e-4175-ad89-8fdf1e9adc77 is going to be updated. [ 1346.295704] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.295986] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.296124] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.296432] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.296660] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.296899] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-347e97f8-125e-4175-ad89-8fdf1e9adc77" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.956752] env[70392]: INFO networking_nsxv3.common.synchronization [req-5a7847d6-ec7d-47af-8ad0-18132d322c23 req-81dd7577-316b-4802-a3d6-91156ca4cd9b service nova] Enqueued Resource ID: 2515ad2c-fd11-420c-a9b5-5e230c52781f with Priority: HIGHEST for action security_group_rules [ 1346.956850] env[70392]: INFO networking_nsxv3.common.synchronization [req-5a7847d6-ec7d-47af-8ad0-18132d322c23 req-81dd7577-316b-4802-a3d6-91156ca4cd9b service nova] Enqueued Resource ID: 2515ad2c-fd11-420c-a9b5-5e230c52781f with Priority: HIGHEST for action security_group_members [ 1346.957039] env[70392]: INFO networking_nsxv3.common.synchronization [req-5a7847d6-ec7d-47af-8ad0-18132d322c23 req-81dd7577-316b-4802-a3d6-91156ca4cd9b service nova] Enqueued Resource ID: 347e97f8-125e-4175-ad89-8fdf1e9adc77 with Priority: HIGHEST for action port [ 1346.957206] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2515ad2c-fd11-420c-a9b5-5e230c52781f with Priority: HIGHEST for action security_group_rules [ 1346.957344] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2515ad2c-fd11-420c-a9b5-5e230c52781f with Priority: HIGHEST for action security_group_members [ 1346.957472] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 347e97f8-125e-4175-ad89-8fdf1e9adc77 with Priority: HIGHEST for action port [ 1346.958109] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2515ad2c-fd11-420c-a9b5-5e230c52781f taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.958288] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2515ad2c-fd11-420c-a9b5-5e230c52781f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.958288] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2515ad2c-fd11-420c-a9b5-5e230c52781f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.958502] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2515ad2c-fd11-420c-a9b5-5e230c52781f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.958578] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2515ad2c-fd11-420c-a9b5-5e230c52781f',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1346.959469] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-2515ad2c-fd11-420c-a9b5-5e230c52781f taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.959557] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2515ad2c-fd11-420c-a9b5-5e230c52781f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.959614] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2515ad2c-fd11-420c-a9b5-5e230c52781f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.959798] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2515ad2c-fd11-420c-a9b5-5e230c52781f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.959875] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.959968] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.960071] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.960221] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.960318] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.960424] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2515ad2c-fd11-420c-a9b5-5e230c52781f',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1346.961648] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-347e97f8-125e-4175-ad89-8fdf1e9adc77 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.961758] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-347e97f8-125e-4175-ad89-8fdf1e9adc77" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.961830] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-347e97f8-125e-4175-ad89-8fdf1e9adc77" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.961965] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-347e97f8-125e-4175-ad89-8fdf1e9adc77" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.962044] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('347e97f8-125e-4175-ad89-8fdf1e9adc77',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1347.464269] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-2515ad2c-fd11-420c-a9b5-5e230c52781f taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.464691] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2515ad2c-fd11-420c-a9b5-5e230c52781f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.464691] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2515ad2c-fd11-420c-a9b5-5e230c52781f',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1347.466211] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 347e97f8-125e-4175-ad89-8fdf1e9adc77 with status ACTIVE [ 1347.466408] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.466531] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.466599] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.466824] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.466897] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.467079] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.467178] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.467233] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.467385] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.467462] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.467641] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.467736] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.467868] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.468043] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.468124] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.468235] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 347e97f8-125e-4175-ad89-8fdf1e9adc77 is going to be updated. [ 1347.488769] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.488974] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.488974] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.489226] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.489378] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.489570] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-347e97f8-125e-4175-ad89-8fdf1e9adc77" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.967720] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2515ad2c-fd11-420c-a9b5-5e230c52781f',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1348.070366] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95c32541-66a7-4f87-ab53-411ea5d5172e in Status: SUCCESS [ 1348.070544] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95c32541-66a7-4f87-ab53-411ea5d5172e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.070727] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95c32541-66a7-4f87-ab53-411ea5d5172e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.070972] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95c32541-66a7-4f87-ab53-411ea5d5172e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.071193] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.071311] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.071369] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.071531] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.071610] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.071694] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95c32541-66a7-4f87-ab53-411ea5d5172e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.071785] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('95c32541-66a7-4f87-ab53-411ea5d5172e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1348.470070] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.470070] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.470070] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.470572] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.470572] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.470572] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2515ad2c-fd11-420c-a9b5-5e230c52781f is going to be updated. [ 1348.506658] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.506896] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.506943] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.507166] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.507318] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.517337] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2515ad2c-fd11-420c-a9b5-5e230c52781f in Status: IN_PROGRESS for 2s [ 1348.574263] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('95c32541-66a7-4f87-ab53-411ea5d5172e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1349.076749] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 95c32541-66a7-4f87-ab53-411ea5d5172e: rpc.has_security_group_logging(os_id): False [ 1349.094212] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.094416] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.094416] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.094593] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.094682] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.094919] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.095050] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.095115] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.095237] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.095312] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.095395] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 95c32541-66a7-4f87-ab53-411ea5d5172e is going to be created. [ 1349.155514] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.155743] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.155743] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.155942] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.156078] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.168953] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 95c32541-66a7-4f87-ab53-411ea5d5172e in Status: IN_PROGRESS for 2s [ 1350.529302] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2515ad2c-fd11-420c-a9b5-5e230c52781f in Status: SUCCESS [ 1350.529678] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2515ad2c-fd11-420c-a9b5-5e230c52781f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.529678] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2515ad2c-fd11-420c-a9b5-5e230c52781f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.529879] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2515ad2c-fd11-420c-a9b5-5e230c52781f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.530116] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.530247] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.530299] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.530461] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.530543] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.530629] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2515ad2c-fd11-420c-a9b5-5e230c52781f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.530723] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2515ad2c-fd11-420c-a9b5-5e230c52781f',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1351.036823] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2515ad2c-fd11-420c-a9b5-5e230c52781f',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1351.182127] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 95c32541-66a7-4f87-ab53-411ea5d5172e in Status: SUCCESS [ 1351.182347] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-95c32541-66a7-4f87-ab53-411ea5d5172e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.539508] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2515ad2c-fd11-420c-a9b5-5e230c52781f: rpc.has_security_group_logging(os_id): False [ 1351.558355] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.558562] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.558562] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.558797] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.558883] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.559146] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.559266] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.559343] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.559504] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.559606] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.559714] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2515ad2c-fd11-420c-a9b5-5e230c52781f is going to be updated. [ 1351.607194] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.607377] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.607604] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.607842] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.608290] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1351.626189] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.626336] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.626404] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.626635] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.626786] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.639568] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2515ad2c-fd11-420c-a9b5-5e230c52781f in Status: IN_PROGRESS for 2s [ 1351.958453] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1351.958637] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1352.110782] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1352.614030] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1353.115426] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1353.115588] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1353.661846] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2515ad2c-fd11-420c-a9b5-5e230c52781f in Status: SUCCESS [ 1353.662210] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2515ad2c-fd11-420c-a9b5-5e230c52781f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.083877] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.084071] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.084187] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.084456] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.099052] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1354.099925] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.101111] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1354.144174] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.144426] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.144426] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.144679] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.159661] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.160617] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1354.160719] env[70392]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=70392) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1354.160825] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1354.215726] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.216025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.216025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.216191] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.217647] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.218436] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1354.304374] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.304529] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.304579] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.304785] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.305126] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.305425] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1354.389595] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.389885] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.390052] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.390461] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.390963] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.391613] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:46. [ 1354.391719] env[70392]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'0ee28657-f5b1-4532-8f08-2a14f39970ca', 'ad5e0335-03f5-413e-88dc-5138f0daa778', '47a435cb-d815-4f84-b215-41c82faf33b9', '25d71d6e-f381-40cd-b3d0-6c5c495c4c87', 'ce79170a-31ce-429e-8e08-a911557872f4', 'eee84844-ea79-48de-9294-c53a759dc328', 'e473c6e0-5940-4d57-ba2e-d012e6d8eeb9', 'f5251c5e-578a-48aa-8195-e1dc88834ad8', '0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f', '81234d09-eeda-4e4f-bbe7-9aa250a3b427', '7134cdd3-ca0e-4544-bb16-183af6eac784', 'bb62eb06-eeb8-448e-a256-ef5cfef1b811', '4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b', 'b60d7eaa-9583-4c75-97fa-4049c63576b6', '19062702-bd29-4477-a732-5169f347b4da', '2515ad2c-fd11-420c-a9b5-5e230c52781f', '07383bb9-9bd2-43da-8cb5-da905d6129d5', 'f8c45013-4f96-4753-81c1-dc9e755bf45a', '95c32541-66a7-4f87-ab53-411ea5d5172e', '63340db4-2f8e-4cd1-a989-33f56aac8213', '2e375ce9-a326-43ce-b62b-e40b371dfd91', 'db50a8fd-2283-44bb-910d-f7a2f2541f14', '73f697c6-7f54-4f76-8856-ccf1651be1c2', 'f0999f45-c89f-488f-b038-36a93b2cdeb4', '12100879-b33a-4e8b-8947-ed54d332f821', 'ac589e4e-a2e5-4716-8490-eecefc1b6a5e', '7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5', '4f7f8865-743f-4e67-8bf2-9a21ed1eaac4', 'e33b6cac-e9e7-4fe8-a87b-2dee2c42645e', 'bca01ddc-73d5-4856-bbff-aefad642492a', '2dfa1026-01a5-4176-a643-8ab1ceda5ce6', '839b66b0-e5ba-4f94-b08b-508956410270', '3507e503-4abd-47ec-8347-82fc9e691881', 'fcc3c75c-0cae-4c7c-8f32-6c948e76880d', 'c3e59ae3-629d-4146-9bee-ef9808a03841', '49e97029-e971-47d3-aa73-0fe54ba5d0b0', '438fa731-ac4f-4636-ae4b-8e30973002cd', '623be016-3395-49f1-ae71-2a2052cde818', 'ee8b641c-b2f7-4b94-85bb-98a31dba1604', 'cca6e4dd-68c9-4fd2-8e1a-cda645da02e4', 'c1385665-0c09-423f-98c4-4d6b46c66ec0', '59adf132-72f4-4d43-847e-1af9bc3c6073', '56238df1-04a7-4a59-9d0f-ea911fb29f15', '03a8a1fe-a465-4403-8e2c-2170f54b59a0', 'fc49f827-a914-4b77-820c-bb2bf63c8bc7', '44698b7f-7125-46d0-837f-5d44d3ee1aea'} {{(pid=70392) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1354.391833] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1354.411968] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.412269] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.412403] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.412787] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.412991] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.413161] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1354.413292] env[70392]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=70392) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1354.413443] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1354.503222] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.503458] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.503619] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.503805] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.505014] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.505346] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1354.505481] env[70392]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=70392) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1354.505481] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1354.505594] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1354.505643] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/46 resources of Type:Security Group Rules [ 1354.505699] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0ee28657-f5b1-4532-8f08-2a14f39970ca with Priority: HIGH for action security_group_rules [ 1354.505794] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ad5e0335-03f5-413e-88dc-5138f0daa778 with Priority: HIGH for action security_group_rules [ 1354.505867] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 47a435cb-d815-4f84-b215-41c82faf33b9 with Priority: HIGH for action security_group_rules [ 1354.505932] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 25d71d6e-f381-40cd-b3d0-6c5c495c4c87 with Priority: HIGH for action security_group_rules [ 1354.505996] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ce79170a-31ce-429e-8e08-a911557872f4 with Priority: HIGH for action security_group_rules [ 1354.506067] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: eee84844-ea79-48de-9294-c53a759dc328 with Priority: HIGH for action security_group_rules [ 1354.506128] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 with Priority: HIGH for action security_group_rules [ 1354.506191] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f5251c5e-578a-48aa-8195-e1dc88834ad8 with Priority: HIGH for action security_group_rules [ 1354.506254] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f with Priority: HIGH for action security_group_rules [ 1354.506307] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 with Priority: HIGH for action security_group_rules [ 1354.506372] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7134cdd3-ca0e-4544-bb16-183af6eac784 with Priority: HIGH for action security_group_rules [ 1354.506431] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bb62eb06-eeb8-448e-a256-ef5cfef1b811 with Priority: HIGH for action security_group_rules [ 1354.506492] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b with Priority: HIGH for action security_group_rules [ 1354.506549] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 with Priority: HIGH for action security_group_rules [ 1354.506632] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 19062702-bd29-4477-a732-5169f347b4da with Priority: HIGH for action security_group_rules [ 1354.506745] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2515ad2c-fd11-420c-a9b5-5e230c52781f with Priority: HIGH for action security_group_rules [ 1354.506843] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 07383bb9-9bd2-43da-8cb5-da905d6129d5 with Priority: HIGH for action security_group_rules [ 1354.506911] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f8c45013-4f96-4753-81c1-dc9e755bf45a with Priority: HIGH for action security_group_rules [ 1354.506973] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 95c32541-66a7-4f87-ab53-411ea5d5172e with Priority: HIGH for action security_group_rules [ 1354.507047] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 63340db4-2f8e-4cd1-a989-33f56aac8213 with Priority: HIGH for action security_group_rules [ 1354.507240] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.868695] env[70392]: INFO networking_nsxv3.common.synchronization [req-6ccdec83-79d2-48c8-a647-b6952afe1e2d req-39c1f859-fe9c-482f-a273-bf8f72f8593e tempest-ServerActionsTestOtherA-1411478130 tempest-ServerActionsTestOtherA-1411478130-project-member] Enqueued Resource ID: 47a435cb-d815-4f84-b215-41c82faf33b9 with Priority: HIGHEST for action security_group_members [ 1356.869296] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47a435cb-d815-4f84-b215-41c82faf33b9 with Priority: HIGHEST for action security_group_members [ 1356.869455] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ee28657-f5b1-4532-8f08-2a14f39970ca with Priority: HIGH for action security_group_rules [ 1356.869562] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47a435cb-d815-4f84-b215-41c82faf33b9 with Priority: HIGH for action security_group_rules [ 1356.869660] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 with Priority: HIGH for action security_group_rules [ 1356.869754] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19062702-bd29-4477-a732-5169f347b4da with Priority: HIGH for action security_group_rules [ 1356.869845] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63340db4-2f8e-4cd1-a989-33f56aac8213 with Priority: HIGH for action security_group_rules [ 1356.869936] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95c32541-66a7-4f87-ab53-411ea5d5172e with Priority: HIGH for action security_group_rules [ 1356.870040] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8c45013-4f96-4753-81c1-dc9e755bf45a with Priority: HIGH for action security_group_rules [ 1356.870135] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07383bb9-9bd2-43da-8cb5-da905d6129d5 with Priority: HIGH for action security_group_rules [ 1356.870321] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 with Priority: HIGH for action security_group_rules [ 1356.870414] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2515ad2c-fd11-420c-a9b5-5e230c52781f with Priority: HIGH for action security_group_rules [ 1356.870526] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b with Priority: HIGH for action security_group_rules [ 1356.870668] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb62eb06-eeb8-448e-a256-ef5cfef1b811 with Priority: HIGH for action security_group_rules [ 1356.870766] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7134cdd3-ca0e-4544-bb16-183af6eac784 with Priority: HIGH for action security_group_rules [ 1356.870855] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 with Priority: HIGH for action security_group_rules [ 1356.870940] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f with Priority: HIGH for action security_group_rules [ 1356.871039] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eee84844-ea79-48de-9294-c53a759dc328 with Priority: HIGH for action security_group_rules [ 1356.871130] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5251c5e-578a-48aa-8195-e1dc88834ad8 with Priority: HIGH for action security_group_rules [ 1356.871216] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce79170a-31ce-429e-8e08-a911557872f4 with Priority: HIGH for action security_group_rules [ 1356.871400] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad5e0335-03f5-413e-88dc-5138f0daa778 with Priority: HIGH for action security_group_rules [ 1356.871493] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25d71d6e-f381-40cd-b3d0-6c5c495c4c87 with Priority: HIGH for action security_group_rules [ 1356.872229] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-47a435cb-d815-4f84-b215-41c82faf33b9 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.872229] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.872229] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.872229] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.872474] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.872474] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.872474] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.872625] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.872712] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.872805] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47a435cb-d815-4f84-b215-41c82faf33b9',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1356.873764] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ee28657-f5b1-4532-8f08-2a14f39970ca taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.873870] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ee28657-f5b1-4532-8f08-2a14f39970ca" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.873919] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ee28657-f5b1-4532-8f08-2a14f39970ca" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.874135] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ee28657-f5b1-4532-8f08-2a14f39970ca" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.874215] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ee28657-f5b1-4532-8f08-2a14f39970ca',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1356.877638] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-47a435cb-d815-4f84-b215-41c82faf33b9 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.877638] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.877638] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.877638] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.877638] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('47a435cb-d815-4f84-b215-41c82faf33b9',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1356.877638] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.877638] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.877638] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.877638] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.877638] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e473c6e0-5940-4d57-ba2e-d012e6d8eeb9',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1356.877638] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-19062702-bd29-4477-a732-5169f347b4da taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.877638] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.877638] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.878620] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.878620] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('19062702-bd29-4477-a732-5169f347b4da',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1356.878620] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-63340db4-2f8e-4cd1-a989-33f56aac8213 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.878620] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-63340db4-2f8e-4cd1-a989-33f56aac8213" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.878899] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-63340db4-2f8e-4cd1-a989-33f56aac8213" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.878899] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-63340db4-2f8e-4cd1-a989-33f56aac8213" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.878899] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('63340db4-2f8e-4cd1-a989-33f56aac8213',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1356.879700] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-95c32541-66a7-4f87-ab53-411ea5d5172e taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.879802] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-95c32541-66a7-4f87-ab53-411ea5d5172e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.879869] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-95c32541-66a7-4f87-ab53-411ea5d5172e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.880286] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-95c32541-66a7-4f87-ab53-411ea5d5172e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.880397] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('95c32541-66a7-4f87-ab53-411ea5d5172e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1356.881684] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f8c45013-4f96-4753-81c1-dc9e755bf45a taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.881884] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f8c45013-4f96-4753-81c1-dc9e755bf45a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.881884] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f8c45013-4f96-4753-81c1-dc9e755bf45a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.882107] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f8c45013-4f96-4753-81c1-dc9e755bf45a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.882195] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f8c45013-4f96-4753-81c1-dc9e755bf45a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1356.882899] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07383bb9-9bd2-43da-8cb5-da905d6129d5 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.883014] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07383bb9-9bd2-43da-8cb5-da905d6129d5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.883246] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07383bb9-9bd2-43da-8cb5-da905d6129d5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.883413] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07383bb9-9bd2-43da-8cb5-da905d6129d5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.883609] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07383bb9-9bd2-43da-8cb5-da905d6129d5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1356.884230] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b60d7eaa-9583-4c75-97fa-4049c63576b6 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.884331] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.884386] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.884538] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.884617] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b60d7eaa-9583-4c75-97fa-4049c63576b6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1356.887505] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2515ad2c-fd11-420c-a9b5-5e230c52781f taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.887639] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2515ad2c-fd11-420c-a9b5-5e230c52781f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.887803] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2515ad2c-fd11-420c-a9b5-5e230c52781f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.887921] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2515ad2c-fd11-420c-a9b5-5e230c52781f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.888014] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2515ad2c-fd11-420c-a9b5-5e230c52781f',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1356.888802] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.888943] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.889063] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.889185] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.889261] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1356.890198] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bb62eb06-eeb8-448e-a256-ef5cfef1b811 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.890786] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bb62eb06-eeb8-448e-a256-ef5cfef1b811" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.890786] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bb62eb06-eeb8-448e-a256-ef5cfef1b811" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.890786] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bb62eb06-eeb8-448e-a256-ef5cfef1b811" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.890786] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bb62eb06-eeb8-448e-a256-ef5cfef1b811',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1356.891871] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7134cdd3-ca0e-4544-bb16-183af6eac784 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.891971] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7134cdd3-ca0e-4544-bb16-183af6eac784" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.892235] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7134cdd3-ca0e-4544-bb16-183af6eac784" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.892235] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7134cdd3-ca0e-4544-bb16-183af6eac784" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.892327] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7134cdd3-ca0e-4544-bb16-183af6eac784',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1356.893374] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-81234d09-eeda-4e4f-bbe7-9aa250a3b427 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.893475] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.893546] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.893790] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.893888] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('81234d09-eeda-4e4f-bbe7-9aa250a3b427',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1356.894667] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.894804] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.894845] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.894989] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.895074] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1356.895851] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eee84844-ea79-48de-9294-c53a759dc328 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.895961] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.896040] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.896253] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.896253] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eee84844-ea79-48de-9294-c53a759dc328',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1356.897309] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f5251c5e-578a-48aa-8195-e1dc88834ad8 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.897418] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f5251c5e-578a-48aa-8195-e1dc88834ad8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.897484] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f5251c5e-578a-48aa-8195-e1dc88834ad8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.897632] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f5251c5e-578a-48aa-8195-e1dc88834ad8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.897706] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f5251c5e-578a-48aa-8195-e1dc88834ad8',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1356.898495] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ce79170a-31ce-429e-8e08-a911557872f4 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.898605] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.898671] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.898821] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.898892] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ce79170a-31ce-429e-8e08-a911557872f4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1356.899569] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad5e0335-03f5-413e-88dc-5138f0daa778 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.899673] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad5e0335-03f5-413e-88dc-5138f0daa778" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.899740] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad5e0335-03f5-413e-88dc-5138f0daa778" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.899890] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad5e0335-03f5-413e-88dc-5138f0daa778" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.899962] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad5e0335-03f5-413e-88dc-5138f0daa778',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1356.900762] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-25d71d6e-f381-40cd-b3d0-6c5c495c4c87 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.901028] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-25d71d6e-f381-40cd-b3d0-6c5c495c4c87" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.901091] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-25d71d6e-f381-40cd-b3d0-6c5c495c4c87" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.901338] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-25d71d6e-f381-40cd-b3d0-6c5c495c4c87" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.901560] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('25d71d6e-f381-40cd-b3d0-6c5c495c4c87',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1356.905976] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('47a435cb-d815-4f84-b215-41c82faf33b9',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1356.931233] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.931425] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.931469] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.931669] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.934017] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.934441] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.953979] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.954199] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.958716] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.958874] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b is going to be deleted. [ 1356.959844] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.960135] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.988851] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.988999] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 19062702-bd29-4477-a732-5169f347b4da is going to be deleted. [ 1356.990013] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.990299] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.014357] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.014548] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ee28657-f5b1-4532-8f08-2a14f39970ca is going to be deleted. [ 1357.046084] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.046320] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.046320] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.046516] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.046610] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.046732] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4cb9e93f-0ffd-47c6-ae49-f80949b3fa0b" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.080286] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.080519] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.080519] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.080698] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.080792] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.080930] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-19062702-bd29-4477-a732-5169f347b4da" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.086361] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.086541] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.086541] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.087530] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.087530] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.087530] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ee28657-f5b1-4532-8f08-2a14f39970ca" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.404388] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.404587] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.404632] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.404826] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.404998] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.405116] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.405178] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.405326] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.405415] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.405507] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.405605] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e473c6e0-5940-4d57-ba2e-d012e6d8eeb9',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1357.411057] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-47a435cb-d815-4f84-b215-41c82faf33b9 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.411193] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.412681] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-95c32541-66a7-4f87-ab53-411ea5d5172e taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.412783] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95c32541-66a7-4f87-ab53-411ea5d5172e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.412875] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95c32541-66a7-4f87-ab53-411ea5d5172e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.413021] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95c32541-66a7-4f87-ab53-411ea5d5172e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.413170] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.413261] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.413325] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.413466] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.413548] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.413630] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95c32541-66a7-4f87-ab53-411ea5d5172e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.413717] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('95c32541-66a7-4f87-ab53-411ea5d5172e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1357.424879] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-2515ad2c-fd11-420c-a9b5-5e230c52781f taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.425058] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2515ad2c-fd11-420c-a9b5-5e230c52781f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.425102] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2515ad2c-fd11-420c-a9b5-5e230c52781f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.425258] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2515ad2c-fd11-420c-a9b5-5e230c52781f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.425422] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.425519] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.425605] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.425793] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.425880] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.425966] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2515ad2c-fd11-420c-a9b5-5e230c52781f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.426067] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2515ad2c-fd11-420c-a9b5-5e230c52781f',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1357.426797] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('47a435cb-d815-4f84-b215-41c82faf33b9',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1357.469079] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.469343] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.469343] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.469507] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.471391] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.471584] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.472294] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.472504] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.473088] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.473174] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.473914] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.474099] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.474665] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.474764] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.475738] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.475887] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.476587] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.476672] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.477478] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.477593] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.478297] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.478391] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.479141] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.479227] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.479814] env[70392]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1357.480383] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.480491] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.481214] env[70392]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1357.481724] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.481817] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.498056] env[70392]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1357.498738] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.498995] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eee84844-ea79-48de-9294-c53a759dc328 is going to be deleted. [ 1357.499986] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.500217] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.520891] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.520891] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 63340db4-2f8e-4cd1-a989-33f56aac8213 is going to be deleted. [ 1357.522154] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.522365] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.545217] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.545353] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bb62eb06-eeb8-448e-a256-ef5cfef1b811 is going to be deleted. [ 1357.546329] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.546573] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.569161] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.569329] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f5251c5e-578a-48aa-8195-e1dc88834ad8 is going to be deleted. [ 1357.570834] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.570834] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.577552] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.577692] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.592488] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.592684] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad5e0335-03f5-413e-88dc-5138f0daa778 is going to be deleted. [ 1357.593573] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.593791] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.608681] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.608947] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.615479] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.615678] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.616547] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.616699] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07383bb9-9bd2-43da-8cb5-da905d6129d5 is going to be deleted. [ 1357.617589] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.617801] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.635283] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.635551] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.656956] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.657113] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.662841] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.662974] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 81234d09-eeda-4e4f-bbe7-9aa250a3b427 is going to be deleted. [ 1357.664019] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.664244] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.784424] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.784736] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.799386] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.799641] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f is going to be deleted. [ 1357.800606] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.800809] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.822524] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.822682] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ce79170a-31ce-429e-8e08-a911557872f4 is going to be deleted. [ 1357.823587] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.823809] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.910391] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e473c6e0-5940-4d57-ba2e-d012e6d8eeb9',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1357.922422] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('95c32541-66a7-4f87-ab53-411ea5d5172e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1357.931397] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2515ad2c-fd11-420c-a9b5-5e230c52781f',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1357.932342] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.932468] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.932540] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.932749] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.932837] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.933038] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47a435cb-d815-4f84-b215-41c82faf33b9 is going to be updated. [ 1357.951492] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.951697] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.956593] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.956734] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b60d7eaa-9583-4c75-97fa-4049c63576b6 is going to be deleted. [ 1357.957620] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.957829] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.987832] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.988078] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.033675] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.033815] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 25d71d6e-f381-40cd-b3d0-6c5c495c4c87 is going to be deleted. [ 1358.034773] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.035038] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.044637] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.044880] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.044995] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.045320] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.045571] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.057242] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47a435cb-d815-4f84-b215-41c82faf33b9 in Status: IN_PROGRESS for 2s [ 1358.063251] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.063251] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.082085] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.082260] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f8c45013-4f96-4753-81c1-dc9e755bf45a is going to be deleted. [ 1358.083188] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.083407] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.122224] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.122451] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.138146] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.138330] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7134cdd3-ca0e-4544-bb16-183af6eac784 is going to be deleted. [ 1358.139281] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.139505] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.139604] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.139732] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-63340db4-2f8e-4cd1-a989-33f56aac8213" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.139895] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.140075] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.140159] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.140327] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eee84844-ea79-48de-9294-c53a759dc328" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.140927] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.141119] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.141211] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.141379] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bb62eb06-eeb8-448e-a256-ef5cfef1b811" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.141517] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.141673] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.141752] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.141867] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f5251c5e-578a-48aa-8195-e1dc88834ad8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.142017] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.142182] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.142264] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.142381] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad5e0335-03f5-413e-88dc-5138f0daa778" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.142509] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.142652] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.142729] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.142840] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07383bb9-9bd2-43da-8cb5-da905d6129d5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.142963] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.143124] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.143207] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.143357] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-81234d09-eeda-4e4f-bbe7-9aa250a3b427" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.143485] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.143630] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.143702] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.143806] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0b2ec3eb-73cb-4eb3-9a11-8ee21baa956f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.143929] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.144086] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.144160] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.144269] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ce79170a-31ce-429e-8e08-a911557872f4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.144393] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.144574] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.144714] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.144771] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b60d7eaa-9583-4c75-97fa-4049c63576b6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.230810] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.231037] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.231037] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.231302] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.231383] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.231501] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-25d71d6e-f381-40cd-b3d0-6c5c495c4c87" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.246170] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.246402] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.246402] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.246583] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.246673] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.246792] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f8c45013-4f96-4753-81c1-dc9e755bf45a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.288391] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.288646] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.288646] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.288790] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.288881] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.289013] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7134cdd3-ca0e-4544-bb16-183af6eac784" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.412723] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e473c6e0-5940-4d57-ba2e-d012e6d8eeb9: rpc.has_security_group_logging(os_id): False [ 1358.424598] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 95c32541-66a7-4f87-ab53-411ea5d5172e: rpc.has_security_group_logging(os_id): False [ 1358.435478] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2515ad2c-fd11-420c-a9b5-5e230c52781f: rpc.has_security_group_logging(os_id): False [ 1358.437306] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.437447] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.437517] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.437723] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.461217] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.461552] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.461672] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.461742] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.461949] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.462049] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.462140] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 is going to be updated. [ 1358.463960] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.464094] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.464153] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.464324] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.465686] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.465777] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.487107] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.487434] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.487539] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.487634] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.487878] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.487966] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.488120] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 95c32541-66a7-4f87-ab53-411ea5d5172e is going to be updated. [ 1358.489284] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.489474] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.524522] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.524856] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.524985] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.525067] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.525283] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.525372] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.525467] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2515ad2c-fd11-420c-a9b5-5e230c52781f is going to be updated. [ 1358.554585] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.554737] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.554810] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.558422] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.558422] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.567570] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 in Status: IN_PROGRESS for 2s [ 1358.589030] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.589030] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.589030] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.589030] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.589030] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.601376] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 95c32541-66a7-4f87-ab53-411ea5d5172e in Status: IN_PROGRESS for 2s [ 1358.611165] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.611313] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.611386] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.611594] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.611738] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.635085] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2515ad2c-fd11-420c-a9b5-5e230c52781f in Status: IN_PROGRESS for 2s [ 1360.071568] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47a435cb-d815-4f84-b215-41c82faf33b9 in Status: SUCCESS [ 1360.072216] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.072216] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.072216] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.072465] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.072565] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.072565] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.072749] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.072824] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.072907] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.073018] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('47a435cb-d815-4f84-b215-41c82faf33b9',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1360.575584] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('47a435cb-d815-4f84-b215-41c82faf33b9',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1360.582278] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 in Status: SUCCESS [ 1360.582780] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.615156] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 95c32541-66a7-4f87-ab53-411ea5d5172e in Status: SUCCESS [ 1360.615442] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-95c32541-66a7-4f87-ab53-411ea5d5172e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.648654] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2515ad2c-fd11-420c-a9b5-5e230c52781f in Status: SUCCESS [ 1360.648739] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2515ad2c-fd11-420c-a9b5-5e230c52781f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.077593] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 47a435cb-d815-4f84-b215-41c82faf33b9: rpc.has_security_group_logging(os_id): False [ 1361.095652] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.095921] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.095921] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.096115] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.121043] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.121043] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.121043] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.121043] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.121043] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.121043] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.121043] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 47a435cb-d815-4f84-b215-41c82faf33b9 is going to be updated. [ 1361.200194] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.200493] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.200493] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.200596] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.200743] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.229155] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 47a435cb-d815-4f84-b215-41c82faf33b9 in Status: IN_PROGRESS for 2s [ 1361.873070] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1361.873331] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1363.247071] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 47a435cb-d815-4f84-b215-41c82faf33b9 in Status: SUCCESS [ 1363.247481] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.874465] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1366.874891] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1371.875541] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1371.875541] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1375.009344] env[70392]: INFO networking_nsxv3.common.synchronization [req-ba480ca4-9519-46cd-a53d-a4bb8584aaa4 req-aa2cd8aa-52b4-4089-b328-7aeb6ae98dc5 tempest-ServerActionsTestOtherA-1411478130 tempest-ServerActionsTestOtherA-1411478130-project-member] Enqueued Resource ID: 47a435cb-d815-4f84-b215-41c82faf33b9 with Priority: HIGHEST for action security_group_members [ 1375.009911] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47a435cb-d815-4f84-b215-41c82faf33b9 with Priority: HIGHEST for action security_group_members [ 1375.010216] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-47a435cb-d815-4f84-b215-41c82faf33b9 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.010337] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.010403] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.010634] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.010790] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.010889] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.010952] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.011135] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.011217] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.013654] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47a435cb-d815-4f84-b215-41c82faf33b9',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1375.513692] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.513959] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.513959] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.514179] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.514307] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.514625] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.514771] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.514839] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.515034] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.515118] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.515208] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47a435cb-d815-4f84-b215-41c82faf33b9 is going to be updated. [ 1375.548992] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.548992] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.548992] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.548992] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.548992] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.556791] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47a435cb-d815-4f84-b215-41c82faf33b9 in Status: IN_PROGRESS for 2s [ 1377.569190] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47a435cb-d815-4f84-b215-41c82faf33b9 in Status: SUCCESS [ 1377.569602] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47a435cb-d815-4f84-b215-41c82faf33b9 deletion is rescheduled due to dependency. [ 1377.569702] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1380.011421] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1380.011810] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1383.493087] env[70392]: INFO networking_nsxv3.common.synchronization [None req-1c897988-c759-4f7a-9fe8-712d384c1792 None None] Enqueued Resource ID: 2adbd554-e7e7-46ad-8d78-2e27984d3d37 with Priority: HIGHEST for action port [ 1383.493529] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2adbd554-e7e7-46ad-8d78-2e27984d3d37 with Priority: HIGHEST for action port [ 1383.494054] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-2adbd554-e7e7-46ad-8d78-2e27984d3d37 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.494193] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2adbd554-e7e7-46ad-8d78-2e27984d3d37" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.494270] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2adbd554-e7e7-46ad-8d78-2e27984d3d37" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.494503] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2adbd554-e7e7-46ad-8d78-2e27984d3d37" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.494626] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2adbd554-e7e7-46ad-8d78-2e27984d3d37',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1383.997368] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2adbd554-e7e7-46ad-8d78-2e27984d3d37 [ 1383.998485] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.998485] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.998485] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.998485] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.998485] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.998485] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2adbd554-e7e7-46ad-8d78-2e27984d3d37 already deleted. [ 1383.998485] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2adbd554-e7e7-46ad-8d78-2e27984d3d37" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.586615] env[70392]: INFO networking_nsxv3.common.synchronization [None req-6808029b-8e4d-4a05-b013-03107805d087 None None] Enqueued Resource ID: 7c6d1a63-c72c-4a09-b55e-335661dca568 with Priority: HIGHEST for action port [ 1385.587027] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c6d1a63-c72c-4a09-b55e-335661dca568 with Priority: HIGHEST for action port [ 1385.587452] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c6d1a63-c72c-4a09-b55e-335661dca568 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.587638] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c6d1a63-c72c-4a09-b55e-335661dca568" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.587694] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c6d1a63-c72c-4a09-b55e-335661dca568" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.587922] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c6d1a63-c72c-4a09-b55e-335661dca568" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.588029] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c6d1a63-c72c-4a09-b55e-335661dca568',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1386.090202] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7c6d1a63-c72c-4a09-b55e-335661dca568 [ 1386.090567] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.090723] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.090868] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.091200] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.091337] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.091475] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7c6d1a63-c72c-4a09-b55e-335661dca568 already deleted. [ 1386.091622] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c6d1a63-c72c-4a09-b55e-335661dca568" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.745121] env[70392]: INFO networking_nsxv3.common.synchronization [req-bae7a26d-e732-4f2c-8a8b-f38d4ca82176 req-5b02eaaa-3e91-4f31-abb1-22892554545c tempest-ServerAddressesNegativeTestJSON-86453250 tempest-ServerAddressesNegativeTestJSON-86453250-project-member] Enqueued Resource ID: cecf942b-0f7e-4cdd-81a1-7f09ac513a05 with Priority: HIGHEST for action security_group_members [ 1388.745121] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cecf942b-0f7e-4cdd-81a1-7f09ac513a05 with Priority: HIGHEST for action security_group_members [ 1388.745715] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-cecf942b-0f7e-4cdd-81a1-7f09ac513a05 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.746020] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cecf942b-0f7e-4cdd-81a1-7f09ac513a05" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.746234] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cecf942b-0f7e-4cdd-81a1-7f09ac513a05" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.746601] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cecf942b-0f7e-4cdd-81a1-7f09ac513a05" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.746893] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.747215] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.747418] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.748854] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.748854] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.748854] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cecf942b-0f7e-4cdd-81a1-7f09ac513a05',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1389.016079] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-152 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.017076] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-152" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.017076] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-152" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.017076] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-152" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.017258] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.017343] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.017399] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.017619] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.017769] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.017984] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1389.018125] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1389.018241] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1389.018356] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1389.018472] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1389.018582] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1389.018715] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1389.039999] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1389.040222] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1389.040375] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1389.040580] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-152" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.040918] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-71fbc85c-2b76-4565-9320-aa717ae5db50 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.041112] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-71fbc85c-2b76-4565-9320-aa717ae5db50" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.041237] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-71fbc85c-2b76-4565-9320-aa717ae5db50" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.041570] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-71fbc85c-2b76-4565-9320-aa717ae5db50" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.041715] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71fbc85c-2b76-4565-9320-aa717ae5db50',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1389.249752] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.249936] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.250016] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.250218] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.250312] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.250509] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.250601] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.250669] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.250887] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.250970] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.251075] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cecf942b-0f7e-4cdd-81a1-7f09ac513a05 already deleted. [ 1389.251157] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cecf942b-0f7e-4cdd-81a1-7f09ac513a05" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.544719] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.544719] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.544719] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.545013] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.545188] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.545352] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 71fbc85c-2b76-4565-9320-aa717ae5db50 not found, creating... [ 1389.545616] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.545778] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.545902] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.546152] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.546295] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.546578] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.546738] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.546861] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.547085] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.547229] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.547374] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 71fbc85c-2b76-4565-9320-aa717ae5db50 is going to be created. [ 1389.571942] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.572630] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.572865] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.573483] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.573860] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.574315] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-71fbc85c-2b76-4565-9320-aa717ae5db50" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.246792] env[70392]: INFO networking_nsxv3.common.synchronization [req-bae7a26d-e732-4f2c-8a8b-f38d4ca82176 req-e9850d16-96cf-4a3c-9e8e-b4e6b0453dcf service nova] Enqueued Resource ID: cecf942b-0f7e-4cdd-81a1-7f09ac513a05 with Priority: HIGHEST for action security_group_rules [ 1390.247069] env[70392]: INFO networking_nsxv3.common.synchronization [req-bae7a26d-e732-4f2c-8a8b-f38d4ca82176 req-e9850d16-96cf-4a3c-9e8e-b4e6b0453dcf service nova] Enqueued Resource ID: cecf942b-0f7e-4cdd-81a1-7f09ac513a05 with Priority: HIGHEST for action security_group_members [ 1390.247143] env[70392]: INFO networking_nsxv3.common.synchronization [req-bae7a26d-e732-4f2c-8a8b-f38d4ca82176 req-e9850d16-96cf-4a3c-9e8e-b4e6b0453dcf service nova] Enqueued Resource ID: 71fbc85c-2b76-4565-9320-aa717ae5db50 with Priority: HIGHEST for action port [ 1390.247375] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cecf942b-0f7e-4cdd-81a1-7f09ac513a05 with Priority: HIGHEST for action security_group_rules [ 1390.247503] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cecf942b-0f7e-4cdd-81a1-7f09ac513a05 with Priority: HIGHEST for action security_group_members [ 1390.247598] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71fbc85c-2b76-4565-9320-aa717ae5db50 with Priority: HIGHEST for action port [ 1390.248196] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cecf942b-0f7e-4cdd-81a1-7f09ac513a05 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.248351] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cecf942b-0f7e-4cdd-81a1-7f09ac513a05" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.248565] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cecf942b-0f7e-4cdd-81a1-7f09ac513a05" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.248695] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cecf942b-0f7e-4cdd-81a1-7f09ac513a05" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.248823] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cecf942b-0f7e-4cdd-81a1-7f09ac513a05',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1390.249871] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-cecf942b-0f7e-4cdd-81a1-7f09ac513a05 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.249979] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cecf942b-0f7e-4cdd-81a1-7f09ac513a05" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.250048] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cecf942b-0f7e-4cdd-81a1-7f09ac513a05" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.250229] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cecf942b-0f7e-4cdd-81a1-7f09ac513a05" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.250391] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.250481] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.250619] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.250685] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.250766] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.250873] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cecf942b-0f7e-4cdd-81a1-7f09ac513a05',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1390.251975] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-71fbc85c-2b76-4565-9320-aa717ae5db50 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.252050] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-71fbc85c-2b76-4565-9320-aa717ae5db50" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.252104] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-71fbc85c-2b76-4565-9320-aa717ae5db50" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.252262] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-71fbc85c-2b76-4565-9320-aa717ae5db50" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.252337] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71fbc85c-2b76-4565-9320-aa717ae5db50',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1390.753809] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-cecf942b-0f7e-4cdd-81a1-7f09ac513a05 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.753904] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cecf942b-0f7e-4cdd-81a1-7f09ac513a05" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.754110] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cecf942b-0f7e-4cdd-81a1-7f09ac513a05',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1390.755061] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 71fbc85c-2b76-4565-9320-aa717ae5db50 with status ACTIVE [ 1390.756996] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.756996] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.756996] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.756996] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.756996] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.756996] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.756996] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.756996] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.756996] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.756996] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.756996] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.756996] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.756996] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.756996] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.756996] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.757665] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 71fbc85c-2b76-4565-9320-aa717ae5db50 is going to be updated. [ 1390.780483] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.780761] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.780761] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.781099] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.781295] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.781500] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-71fbc85c-2b76-4565-9320-aa717ae5db50" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.259754] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cecf942b-0f7e-4cdd-81a1-7f09ac513a05',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1391.762844] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.763017] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.763084] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.763376] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.763468] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.763578] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cecf942b-0f7e-4cdd-81a1-7f09ac513a05 is going to be created. [ 1391.791496] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.791722] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.791777] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.791950] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.792132] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.803768] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cecf942b-0f7e-4cdd-81a1-7f09ac513a05 in Status: UNINITIALIZED for 2s [ 1393.815316] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cecf942b-0f7e-4cdd-81a1-7f09ac513a05 in Status: SUCCESS [ 1393.815699] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cecf942b-0f7e-4cdd-81a1-7f09ac513a05" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.815894] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cecf942b-0f7e-4cdd-81a1-7f09ac513a05" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.816190] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cecf942b-0f7e-4cdd-81a1-7f09ac513a05" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.816403] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.816526] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.816593] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.816804] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.816944] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.817109] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cecf942b-0f7e-4cdd-81a1-7f09ac513a05" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.817305] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cecf942b-0f7e-4cdd-81a1-7f09ac513a05',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1394.319890] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-cecf942b-0f7e-4cdd-81a1-7f09ac513a05 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.319890] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cecf942b-0f7e-4cdd-81a1-7f09ac513a05" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.319890] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cecf942b-0f7e-4cdd-81a1-7f09ac513a05" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.322047] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cecf942b-0f7e-4cdd-81a1-7f09ac513a05" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.322047] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.322047] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.322047] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.322047] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.322047] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.322047] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cecf942b-0f7e-4cdd-81a1-7f09ac513a05" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.322047] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-cecf942b-0f7e-4cdd-81a1-7f09ac513a05 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.322047] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cecf942b-0f7e-4cdd-81a1-7f09ac513a05" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.322047] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cecf942b-0f7e-4cdd-81a1-7f09ac513a05" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.322047] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cecf942b-0f7e-4cdd-81a1-7f09ac513a05" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.322047] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.322047] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.322047] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.322047] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.322047] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.322943] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cecf942b-0f7e-4cdd-81a1-7f09ac513a05" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.322943] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cecf942b-0f7e-4cdd-81a1-7f09ac513a05',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1394.825101] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cecf942b-0f7e-4cdd-81a1-7f09ac513a05: rpc.has_security_group_logging(os_id): False [ 1394.842536] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.842748] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.842748] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.842910] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.843047] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.843224] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.843320] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.843374] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.843516] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.843591] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.843799] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.843893] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.843980] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.844115] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.844191] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.844371] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.844458] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.844553] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.844695] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.844767] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.844853] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cecf942b-0f7e-4cdd-81a1-7f09ac513a05 is going to be created. [ 1394.909247] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.909482] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.909482] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.909650] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.909826] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.920752] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cecf942b-0f7e-4cdd-81a1-7f09ac513a05 in Status: IN_PROGRESS for 2s [ 1395.248738] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1395.248962] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1396.934546] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cecf942b-0f7e-4cdd-81a1-7f09ac513a05 in Status: SUCCESS [ 1396.934919] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cecf942b-0f7e-4cdd-81a1-7f09ac513a05" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.096030] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-452 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.096294] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-452" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.096468] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-452" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.096778] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-452" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.097120] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.097350] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.097508] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.097743] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.097896] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.098134] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1397.098260] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1397.098381] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1397.098496] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1397.098619] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1397.098732] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1397.098947] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1397.121717] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1397.121919] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1397.121992] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1397.122359] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-452" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.122687] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-4efb56b8-aac1-4900-9115-6bb4d3344aba taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.122866] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-4efb56b8-aac1-4900-9115-6bb4d3344aba" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.122993] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-4efb56b8-aac1-4900-9115-6bb4d3344aba" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.123295] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-4efb56b8-aac1-4900-9115-6bb4d3344aba" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.123438] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4efb56b8-aac1-4900-9115-6bb4d3344aba',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1397.626317] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.626564] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.626696] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.626994] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.627172] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.627493] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.627844] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.627844] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.628017] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.628168] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.628456] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.628616] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.628735] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.628970] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.629149] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.629302] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 4efb56b8-aac1-4900-9115-6bb4d3344aba is going to be updated. [ 1397.650775] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.651070] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.651219] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.651522] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.651738] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.651984] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-4efb56b8-aac1-4900-9115-6bb4d3344aba" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.338992] env[70392]: INFO networking_nsxv3.common.synchronization [req-7d805ddc-2701-4cdd-affd-d58f3ee7603d req-a8f1dd7f-1c27-4cd3-95f5-aadbcbc6dc48 service nova] Enqueued Resource ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 with Priority: HIGHEST for action security_group_rules [ 1398.339267] env[70392]: INFO networking_nsxv3.common.synchronization [req-7d805ddc-2701-4cdd-affd-d58f3ee7603d req-a8f1dd7f-1c27-4cd3-95f5-aadbcbc6dc48 service nova] Enqueued Resource ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 with Priority: HIGHEST for action security_group_members [ 1398.339402] env[70392]: INFO networking_nsxv3.common.synchronization [req-7d805ddc-2701-4cdd-affd-d58f3ee7603d req-a8f1dd7f-1c27-4cd3-95f5-aadbcbc6dc48 service nova] Enqueued Resource ID: 4efb56b8-aac1-4900-9115-6bb4d3344aba with Priority: HIGHEST for action port [ 1398.339632] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 with Priority: HIGHEST for action security_group_rules [ 1398.339760] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 with Priority: HIGHEST for action security_group_members [ 1398.339855] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4efb56b8-aac1-4900-9115-6bb4d3344aba with Priority: HIGHEST for action port [ 1398.340919] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.341117] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.341190] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.341409] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.341492] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1398.342666] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.342666] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.342666] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.342863] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.342863] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.342954] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.342993] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.343144] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.343220] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.343292] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1398.343979] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-4efb56b8-aac1-4900-9115-6bb4d3344aba taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.344096] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4efb56b8-aac1-4900-9115-6bb4d3344aba" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.344162] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4efb56b8-aac1-4900-9115-6bb4d3344aba" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.344306] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4efb56b8-aac1-4900-9115-6bb4d3344aba" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.344380] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4efb56b8-aac1-4900-9115-6bb4d3344aba',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1398.846627] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.846885] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.847045] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1398.848024] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4efb56b8-aac1-4900-9115-6bb4d3344aba with status ACTIVE [ 1398.848236] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.848397] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.848476] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.848698] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.848807] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.849027] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.849154] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.849226] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.849426] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.849530] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.849739] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.849861] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.849956] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.850666] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.850666] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.850666] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4efb56b8-aac1-4900-9115-6bb4d3344aba is going to be updated. [ 1398.879213] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.879524] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.879685] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.879982] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.880146] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.880349] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4efb56b8-aac1-4900-9115-6bb4d3344aba" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.353194] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1399.855961] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.855961] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.855961] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.856257] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.856257] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.856373] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 is going to be updated. [ 1399.889736] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.890014] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.890154] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.890430] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.890587] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.899522] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 in Status: IN_PROGRESS for 2s [ 1400.045104] env[70392]: INFO networking_nsxv3.common.synchronization [req-bcc1d71e-0826-4b7a-871c-8ce19b593bc3 req-d1c533f9-f15c-4183-b636-e0043b3a482b tempest-ServerAddressesNegativeTestJSON-86453250 tempest-ServerAddressesNegativeTestJSON-86453250-project-member] Enqueued Resource ID: cecf942b-0f7e-4cdd-81a1-7f09ac513a05 with Priority: HIGHEST for action security_group_members [ 1400.045643] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cecf942b-0f7e-4cdd-81a1-7f09ac513a05 with Priority: HIGHEST for action security_group_members [ 1400.045941] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-cecf942b-0f7e-4cdd-81a1-7f09ac513a05 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.046158] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cecf942b-0f7e-4cdd-81a1-7f09ac513a05" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.046238] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cecf942b-0f7e-4cdd-81a1-7f09ac513a05" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.046431] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cecf942b-0f7e-4cdd-81a1-7f09ac513a05" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.046595] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.046697] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.046758] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.046897] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.046980] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.047085] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cecf942b-0f7e-4cdd-81a1-7f09ac513a05',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1400.550093] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.550093] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.550093] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.550093] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.550093] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.550659] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.550659] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.550659] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.550659] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.550659] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.550659] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cecf942b-0f7e-4cdd-81a1-7f09ac513a05 is going to be updated. [ 1400.577950] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.578167] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.578167] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.578326] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.578484] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.589102] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cecf942b-0f7e-4cdd-81a1-7f09ac513a05 in Status: IN_PROGRESS for 2s [ 1401.910405] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 in Status: SUCCESS [ 1401.910822] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.911223] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.911511] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.911786] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1401.911920] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1401.911989] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.912176] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.912261] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.912348] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.912481] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1402.414906] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1402.599712] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cecf942b-0f7e-4cdd-81a1-7f09ac513a05 in Status: SUCCESS [ 1402.599870] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cecf942b-0f7e-4cdd-81a1-7f09ac513a05 deletion is rescheduled due to dependency. [ 1402.599996] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cecf942b-0f7e-4cdd-81a1-7f09ac513a05" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.781791] env[70392]: INFO networking_nsxv3.common.synchronization [req-c873233b-b45d-48f8-91b6-21a060b66b78 req-d2b3e2b2-2a26-4210-aaf6-f265abc98e38 tempest-AttachVolumeShelveTestJSON-1019030511 tempest-AttachVolumeShelveTestJSON-1019030511-project-member] Enqueued Resource ID: 2515ad2c-fd11-420c-a9b5-5e230c52781f with Priority: HIGHEST for action security_group_members [ 1402.782445] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2515ad2c-fd11-420c-a9b5-5e230c52781f with Priority: HIGHEST for action security_group_members [ 1402.782759] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-2515ad2c-fd11-420c-a9b5-5e230c52781f taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1402.782884] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2515ad2c-fd11-420c-a9b5-5e230c52781f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1402.782953] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2515ad2c-fd11-420c-a9b5-5e230c52781f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1402.783168] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2515ad2c-fd11-420c-a9b5-5e230c52781f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1402.783327] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1402.783432] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1402.783494] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1402.783636] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1402.783725] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.783883] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2515ad2c-fd11-420c-a9b5-5e230c52781f',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1402.916986] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5: rpc.has_security_group_logging(os_id): False [ 1402.937938] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1402.938085] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1402.938221] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1402.938461] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1402.960789] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.961327] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1402.961457] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1402.961558] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1402.961740] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1402.961819] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.961928] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 is going to be updated. [ 1403.024974] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1403.025137] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1403.025212] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1403.025422] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1403.025571] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1403.044528] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 in Status: IN_PROGRESS for 2s [ 1403.286902] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1403.287113] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1403.287172] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1403.287369] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1403.287476] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1403.287760] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1403.287870] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1403.287931] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1403.288086] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1403.288522] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1403.288522] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2515ad2c-fd11-420c-a9b5-5e230c52781f is going to be updated. [ 1403.332300] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1403.332543] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1403.332543] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1403.332771] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1403.332942] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1403.342057] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2515ad2c-fd11-420c-a9b5-5e230c52781f in Status: IN_PROGRESS for 2s [ 1405.059856] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 in Status: SUCCESS [ 1405.060449] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.351898] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2515ad2c-fd11-420c-a9b5-5e230c52781f in Status: SUCCESS [ 1405.352460] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2515ad2c-fd11-420c-a9b5-5e230c52781f deletion is rescheduled due to dependency. [ 1405.352460] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2515ad2c-fd11-420c-a9b5-5e230c52781f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1407.783915] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1407.784234] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1412.785280] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1412.785653] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1416.163439] env[70392]: INFO networking_nsxv3.common.synchronization [req-42b24d58-afce-4043-ae10-16a267590dc6 req-7648b0ff-140a-4567-951f-de30bb15fd28 tempest-ServerActionsTestOtherB-779604050 tempest-ServerActionsTestOtherB-779604050-project-member] Enqueued Resource ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 with Priority: HIGHEST for action security_group_members [ 1416.164044] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 with Priority: HIGHEST for action security_group_members [ 1416.164831] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1416.164831] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1416.164831] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1416.164831] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1416.165182] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1416.165182] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1416.165182] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1416.165305] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1416.165305] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1416.165752] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1416.667455] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1416.667613] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1416.667720] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1416.668009] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1416.668171] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1416.668431] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1416.668560] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1416.668628] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1416.668792] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1416.668873] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1416.668987] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 is going to be updated. [ 1416.697055] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1416.697224] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1416.697274] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1416.697485] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1416.697636] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1416.706289] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 in Status: IN_PROGRESS for 2s [ 1418.717651] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 in Status: SUCCESS [ 1418.717651] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 deletion is rescheduled due to dependency. [ 1418.718087] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1421.165578] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1421.165770] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1426.166597] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1426.166970] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1431.168564] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1431.168964] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1436.169871] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1436.170308] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1438.186095] env[70392]: INFO networking_nsxv3.common.synchronization [req-da1c88b5-1666-4f45-a379-1bcf3d6a7c71 req-b27f1c5a-f24f-42c5-8f36-2e96a97a0329 tempest-ServerActionsTestJSON-648729814 tempest-ServerActionsTestJSON-648729814-project-member] Enqueued Resource ID: 95c32541-66a7-4f87-ab53-411ea5d5172e with Priority: HIGHEST for action security_group_members [ 1438.187036] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95c32541-66a7-4f87-ab53-411ea5d5172e with Priority: HIGHEST for action security_group_members [ 1438.187372] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-95c32541-66a7-4f87-ab53-411ea5d5172e taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1438.187501] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95c32541-66a7-4f87-ab53-411ea5d5172e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1438.187569] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95c32541-66a7-4f87-ab53-411ea5d5172e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1438.187802] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95c32541-66a7-4f87-ab53-411ea5d5172e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1438.188032] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1438.188100] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1438.188132] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1438.188341] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1438.188479] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1438.188634] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('95c32541-66a7-4f87-ab53-411ea5d5172e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1438.693353] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1438.693538] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1438.693538] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1438.693720] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1438.693816] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1438.694020] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1438.694143] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1438.694197] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1438.694335] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1438.694414] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1438.694503] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95c32541-66a7-4f87-ab53-411ea5d5172e is going to be updated. [ 1438.724647] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1438.724835] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1438.724835] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1438.725038] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1438.725178] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1438.734174] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95c32541-66a7-4f87-ab53-411ea5d5172e in Status: IN_PROGRESS for 2s [ 1440.744991] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95c32541-66a7-4f87-ab53-411ea5d5172e in Status: SUCCESS [ 1440.745377] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95c32541-66a7-4f87-ab53-411ea5d5172e deletion is rescheduled due to dependency. [ 1440.745377] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95c32541-66a7-4f87-ab53-411ea5d5172e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1443.188235] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1443.188503] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1448.190195] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1448.190608] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1453.191773] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1453.192023] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1458.193765] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1458.194109] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1463.195386] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1463.195699] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1468.197194] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1468.197550] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1471.530013] env[70392]: INFO networking_nsxv3.common.synchronization [req-d1978236-12e1-4d82-a242-1077b3232bff req-d95ab07f-a3f9-48d4-b724-0a6d596571c3 tempest-ServerActionsTestJSON-648729814 tempest-ServerActionsTestJSON-648729814-project-member] Enqueued Resource ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 with Priority: HIGHEST for action security_group_members [ 1471.531495] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 with Priority: HIGHEST for action security_group_members [ 1471.531495] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1471.531495] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1471.531495] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1471.531495] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1471.531744] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1471.531744] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1471.532318] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1471.532318] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1471.532318] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1471.532318] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e473c6e0-5940-4d57-ba2e-d012e6d8eeb9',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1472.035207] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1472.035412] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1472.035412] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1472.035638] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1472.035730] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1472.035918] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1472.036029] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1472.036100] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1472.036239] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1472.036316] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1472.036401] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 is going to be updated. [ 1472.066583] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1472.066774] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1472.066774] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1472.066973] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1472.067155] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1472.075926] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 in Status: IN_PROGRESS for 2s [ 1474.087113] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 in Status: SUCCESS [ 1474.087491] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 deletion is rescheduled due to dependency. [ 1474.087491] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1476.531381] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1476.531762] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1479.048069] env[70392]: INFO networking_nsxv3.common.synchronization [req-b4cab1f6-6600-4646-b4f4-e30ee4faec6c req-ca0d2d50-6c77-4e48-a348-c21a83329651 tempest-ServerActionsTestJSON-648729814 tempest-ServerActionsTestJSON-648729814-project-member] Enqueued Resource ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 with Priority: HIGHEST for action security_group_members [ 1479.048069] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 with Priority: HIGHEST for action security_group_members [ 1479.048343] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1479.048459] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1479.048531] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1479.048716] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1479.048865] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1479.048961] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1479.049035] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1479.049184] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1479.049273] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1479.049363] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e473c6e0-5940-4d57-ba2e-d012e6d8eeb9',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1479.311484] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-872 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1479.311696] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-872" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1479.311829] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-872" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1479.312113] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-872" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1479.312384] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1479.312546] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1479.312704] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1479.312955] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1479.313120] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1479.313335] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1479.313454] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1479.313582] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1479.313710] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1479.313831] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1479.313944] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1479.314097] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1479.335159] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1479.335358] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1479.335478] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1479.335657] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-872" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1479.335972] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-52c69fa3-dbac-4b74-887f-be85c9ceaac8 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1479.336163] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-52c69fa3-dbac-4b74-887f-be85c9ceaac8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1479.336287] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-52c69fa3-dbac-4b74-887f-be85c9ceaac8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1479.336628] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-52c69fa3-dbac-4b74-887f-be85c9ceaac8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1479.336801] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52c69fa3-dbac-4b74-887f-be85c9ceaac8',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1479.552020] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1479.552240] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1479.552326] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1479.552558] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1479.552719] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1479.552955] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1479.553124] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1479.553199] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1479.553413] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1479.553505] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1479.553653] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 is going to be updated. [ 1479.580350] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1479.580528] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1479.580528] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1479.580721] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1479.580859] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1479.588866] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 in Status: IN_PROGRESS for 2s [ 1479.839251] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1479.839509] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1479.839553] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1479.839853] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1479.840058] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1479.840197] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port 52c69fa3-dbac-4b74-887f-be85c9ceaac8 not found, creating... [ 1479.840464] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1479.840667] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1479.840804] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1479.841059] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1479.841209] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1479.841504] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1479.841665] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1479.841788] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1479.842010] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1479.842157] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1479.842303] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: 52c69fa3-dbac-4b74-887f-be85c9ceaac8 is going to be created. [ 1479.862314] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1479.862494] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1479.862587] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1479.862882] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1479.863130] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1479.863357] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-52c69fa3-dbac-4b74-887f-be85c9ceaac8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1480.583530] env[70392]: INFO networking_nsxv3.common.synchronization [req-b4cab1f6-6600-4646-b4f4-e30ee4faec6c req-0d562509-9b71-4f67-a176-0f67e8eed346 service nova] Enqueued Resource ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 with Priority: HIGHEST for action security_group_rules [ 1480.583812] env[70392]: INFO networking_nsxv3.common.synchronization [req-b4cab1f6-6600-4646-b4f4-e30ee4faec6c req-0d562509-9b71-4f67-a176-0f67e8eed346 service nova] Enqueued Resource ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 with Priority: HIGHEST for action security_group_members [ 1480.583948] env[70392]: INFO networking_nsxv3.common.synchronization [req-b4cab1f6-6600-4646-b4f4-e30ee4faec6c req-0d562509-9b71-4f67-a176-0f67e8eed346 service nova] Enqueued Resource ID: 52c69fa3-dbac-4b74-887f-be85c9ceaac8 with Priority: HIGHEST for action port [ 1480.584158] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 with Priority: HIGHEST for action security_group_rules [ 1480.584290] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 with Priority: HIGHEST for action security_group_members [ 1480.584387] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52c69fa3-dbac-4b74-887f-be85c9ceaac8 with Priority: HIGHEST for action port [ 1480.584921] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1480.585054] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1480.585131] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1480.585312] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1480.585395] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e473c6e0-5940-4d57-ba2e-d012e6d8eeb9',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1480.586607] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1480.586696] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1480.586890] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-52c69fa3-dbac-4b74-887f-be85c9ceaac8 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1480.586993] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-52c69fa3-dbac-4b74-887f-be85c9ceaac8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1480.587089] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-52c69fa3-dbac-4b74-887f-be85c9ceaac8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1480.587230] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-52c69fa3-dbac-4b74-887f-be85c9ceaac8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1480.587305] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52c69fa3-dbac-4b74-887f-be85c9ceaac8',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1481.089411] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1481.089679] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1481.089679] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 52c69fa3-dbac-4b74-887f-be85c9ceaac8 with status ACTIVE [ 1481.089911] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1481.089911] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1481.090058] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1481.090255] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1481.090352] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1481.090531] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1481.090667] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1481.090727] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1481.090875] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1481.090954] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1481.091162] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1481.091261] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1481.091306] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1481.091449] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1481.091522] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1481.091607] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 52c69fa3-dbac-4b74-887f-be85c9ceaac8 is going to be updated. [ 1481.113323] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1481.113512] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1481.113512] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1481.113732] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1481.113827] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1481.113984] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-52c69fa3-dbac-4b74-887f-be85c9ceaac8" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1481.599239] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 in Status: SUCCESS [ 1481.599578] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 deletion is rescheduled due to dependency. [ 1481.599578] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1481.599753] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1481.599904] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1481.600103] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1481.600224] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1481.600301] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1481.600449] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1481.600649] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1481.600649] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e473c6e0-5940-4d57-ba2e-d012e6d8eeb9',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1482.103590] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e473c6e0-5940-4d57-ba2e-d012e6d8eeb9',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1482.605974] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e473c6e0-5940-4d57-ba2e-d012e6d8eeb9',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1483.108387] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.108588] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1483.108658] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1483.108882] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1483.108973] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1483.109085] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 is going to be updated. [ 1483.138607] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.138823] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1483.138823] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1483.139021] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1483.139227] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1483.147850] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 in Status: IN_PROGRESS for 2s [ 1485.158674] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 in Status: SUCCESS [ 1485.159092] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1485.159092] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1485.159216] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1485.159403] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1485.159519] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1485.159584] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1485.159738] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1485.159820] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1485.159906] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1485.159996] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e473c6e0-5940-4d57-ba2e-d012e6d8eeb9',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1485.585131] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1485.585288] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1485.661852] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e473c6e0-5940-4d57-ba2e-d012e6d8eeb9',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1486.164484] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e473c6e0-5940-4d57-ba2e-d012e6d8eeb9: rpc.has_security_group_logging(os_id): False [ 1486.187724] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1486.187940] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1486.188033] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1486.188197] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1486.188327] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1486.188608] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1486.188712] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1486.188820] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1486.188949] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1486.189034] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1486.189122] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 is going to be updated. [ 1486.249115] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1486.249355] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1486.249355] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1486.249534] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1486.249711] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1486.269712] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 in Status: IN_PROGRESS for 2s [ 1488.284967] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 in Status: SUCCESS [ 1488.285322] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.586338] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1490.586813] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1495.588396] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1495.588744] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1500.590179] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1500.590540] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1505.591173] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1505.591580] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1510.592977] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1510.593419] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1515.594380] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1515.594633] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1520.595513] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1520.597064] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1525.596371] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1525.596628] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1530.597357] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1530.597786] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1535.598584] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1535.598584] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1540.599754] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1540.600170] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1545.600994] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1545.601349] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1550.602239] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1550.602637] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1555.603600] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1555.604049] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1560.440160] env[70392]: INFO networking_nsxv3.common.synchronization [req-1e784b44-8aa3-4d40-934a-2a84f8119b56 req-6f516767-c521-42dd-ad8c-a2ea59026a8b tempest-ServerActionsTestJSON-648729814 tempest-ServerActionsTestJSON-648729814-project-member] Enqueued Resource ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 with Priority: HIGHEST for action security_group_members [ 1560.440693] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 with Priority: HIGHEST for action security_group_members [ 1560.441006] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1560.441139] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1560.441209] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1560.441791] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1560.441791] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1560.441791] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1560.441791] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1560.441971] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1560.442241] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1560.442241] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e473c6e0-5940-4d57-ba2e-d012e6d8eeb9',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1560.944660] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1560.944832] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1560.944940] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1560.945128] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1560.945219] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1560.945442] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1560.945553] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1560.945610] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1560.945763] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1560.945840] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1560.945927] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 is going to be updated. [ 1560.985260] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1560.985487] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1560.985487] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1560.985644] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1560.985783] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1560.994147] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 in Status: IN_PROGRESS for 2s [ 1563.006621] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 in Status: SUCCESS [ 1563.007016] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 deletion is rescheduled due to dependency. [ 1563.007016] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.441838] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1565.442129] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1567.296165] env[70392]: INFO networking_nsxv3.common.synchronization [req-1db19abf-7341-4f9c-a3a9-c4dee0241215 req-dd19f7bb-4e2d-4e7e-bf8a-e31a62c6a44f tempest-ServerActionsTestJSON-648729814 tempest-ServerActionsTestJSON-648729814-project-member] Enqueued Resource ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 with Priority: HIGHEST for action security_group_members [ 1567.296705] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 with Priority: HIGHEST for action security_group_members [ 1567.296914] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1567.297047] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1567.297109] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1567.297307] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1567.297458] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1567.297566] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1567.297607] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1567.297756] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1567.297850] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1567.297957] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e473c6e0-5940-4d57-ba2e-d012e6d8eeb9',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1567.569398] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock network-872 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1567.569610] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "network-872" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1567.569741] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "network-872" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1567.570029] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "network-872" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1567.570308] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1567.570517] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1567.570645] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1567.570906] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1567.571069] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1567.571334] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1567.571481] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] NeedRegenerationException {{(pid=70392) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1567.571597] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] no value, waiting for create lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1567.571716] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] value creation lock acquired {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1567.571866] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] No value present for key: 'zone-id' {{(pid=70392) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1567.571963] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Calling creation function for not-yet-present value {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1567.572113] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1567.593536] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1567.593696] env[70392]: DEBUG dogpile.cache.region [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70392) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1567.593833] env[70392]: DEBUG dogpile.lock [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Released creation lock {{(pid=70392) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1567.594016] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "network-872" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1567.594341] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock port-cb95305a-38c0-4598-8f00-bfb2fab1fb04 taken with stack trace [, , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1567.594558] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "port-cb95305a-38c0-4598-8f00-bfb2fab1fb04" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1567.594681] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "port-cb95305a-38c0-4598-8f00-bfb2fab1fb04" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1567.594991] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "port-cb95305a-38c0-4598-8f00-bfb2fab1fb04" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1567.595148] env[70392]: DEBUG networking_nsxv3.api.rpc [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb95305a-38c0-4598-8f00-bfb2fab1fb04',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1567.800530] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1567.800746] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1567.800803] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1567.801036] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1567.801145] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1567.801355] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1567.801455] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1567.801520] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1567.801675] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1567.801751] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1567.801862] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 is going to be updated. [ 1567.826785] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1567.826978] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1567.826978] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1567.827176] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1567.827314] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1567.835862] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 in Status: IN_PROGRESS for 2s [ 1568.098059] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.098318] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.098459] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1568.098798] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1568.099016] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1568.099219] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Segment Port cb95305a-38c0-4598-8f00-bfb2fab1fb04 not found, creating... [ 1568.099544] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.099736] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.099887] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1568.100143] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1568.100293] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1568.100584] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.100744] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.100865] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1568.101117] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1568.101328] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1568.101470] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Resource: SegmentPort with ID: cb95305a-38c0-4598-8f00-bfb2fab1fb04 is going to be created. [ 1568.122343] env[70392]: DEBUG networking_nsxv3.common.locking [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.122606] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.122743] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1568.123022] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1568.123257] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1568.123497] env[70392]: DEBUG oslo_concurrency.lockutils [None req-433b821f-aedd-42f6-ba8d-508801255787 None None] Releasing lock "port-cb95305a-38c0-4598-8f00-bfb2fab1fb04" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1568.784715] env[70392]: INFO networking_nsxv3.common.synchronization [req-1db19abf-7341-4f9c-a3a9-c4dee0241215 req-db9c7115-8c15-4abf-a0c7-fb6692d3ce31 service nova] Enqueued Resource ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 with Priority: HIGHEST for action security_group_rules [ 1568.785021] env[70392]: INFO networking_nsxv3.common.synchronization [req-1db19abf-7341-4f9c-a3a9-c4dee0241215 req-db9c7115-8c15-4abf-a0c7-fb6692d3ce31 service nova] Enqueued Resource ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 with Priority: HIGHEST for action security_group_members [ 1568.785198] env[70392]: INFO networking_nsxv3.common.synchronization [req-1db19abf-7341-4f9c-a3a9-c4dee0241215 req-db9c7115-8c15-4abf-a0c7-fb6692d3ce31 service nova] Enqueued Resource ID: cb95305a-38c0-4598-8f00-bfb2fab1fb04 with Priority: HIGHEST for action port [ 1568.785273] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 with Priority: HIGHEST for action security_group_rules [ 1568.785396] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 with Priority: HIGHEST for action security_group_members [ 1568.785507] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb95305a-38c0-4598-8f00-bfb2fab1fb04 with Priority: HIGHEST for action port [ 1568.787235] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.787402] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.787479] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1568.787670] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1568.787755] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e473c6e0-5940-4d57-ba2e-d012e6d8eeb9',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1568.789792] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.789889] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.790196] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock port-cb95305a-38c0-4598-8f00-bfb2fab1fb04 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.790310] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cb95305a-38c0-4598-8f00-bfb2fab1fb04" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.790377] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cb95305a-38c0-4598-8f00-bfb2fab1fb04" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1568.790555] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cb95305a-38c0-4598-8f00-bfb2fab1fb04" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1568.790635] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb95305a-38c0-4598-8f00-bfb2fab1fb04',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1569.290622] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.290770] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1569.292088] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cb95305a-38c0-4598-8f00-bfb2fab1fb04 with status ACTIVE [ 1569.292269] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.292384] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1569.292463] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.292668] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.292758] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.292932] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.293046] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1569.293108] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.293259] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.293336] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.293523] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.293616] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1569.293677] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.293815] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.293938] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.293981] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cb95305a-38c0-4598-8f00-bfb2fab1fb04 is going to be updated. [ 1569.315123] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.315282] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1569.315318] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.315525] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.315669] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.315816] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cb95305a-38c0-4598-8f00-bfb2fab1fb04" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.845842] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 in Status: SUCCESS [ 1569.846117] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 deletion is rescheduled due to dependency. [ 1569.846151] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.846302] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.846630] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.846705] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.846820] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1569.846870] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.847036] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.847121] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.847217] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e473c6e0-5940-4d57-ba2e-d012e6d8eeb9',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1570.350160] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e473c6e0-5940-4d57-ba2e-d012e6d8eeb9',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1570.853030] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e473c6e0-5940-4d57-ba2e-d012e6d8eeb9',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1571.355179] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1571.355346] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1571.355390] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1571.355639] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1571.355737] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.355850] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 is going to be updated. [ 1571.383462] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1571.383648] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1571.383648] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1571.383835] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1571.383978] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.393721] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 in Status: IN_PROGRESS for 2s [ 1573.404899] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 in Status: SUCCESS [ 1573.405272] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.405413] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.405640] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.405839] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.405969] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.406069] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.406199] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.406284] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.406423] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.406465] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e473c6e0-5940-4d57-ba2e-d012e6d8eeb9',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1573.786407] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1573.786648] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1573.909221] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e473c6e0-5940-4d57-ba2e-d012e6d8eeb9',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1574.411429] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e473c6e0-5940-4d57-ba2e-d012e6d8eeb9: rpc.has_security_group_logging(os_id): False [ 1574.428965] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1574.429165] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1574.429213] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1574.429395] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1574.429498] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.429735] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1574.429836] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1574.429892] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1574.430054] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1574.430136] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.430216] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 is going to be updated. [ 1574.487400] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1574.487608] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1574.487608] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1574.487807] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1574.487955] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.523751] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 in Status: IN_PROGRESS for 2s [ 1576.539156] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 in Status: SUCCESS [ 1576.539586] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1578.787612] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1578.787612] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1583.788886] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1583.789250] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1585.665025] env[70392]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] NSXv3 Agent Agent loop - iteration:3 completed [ 1585.665423] env[70392]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-c6d6a65e-5abb-437b-8637-08f522679493 None None] NSXv3 Agent Agent loop - iteration:4 started [ 1588.789884] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1588.790295] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1591.609068] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1591.609068] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1591.609068] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1591.609068] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1591.609068] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1592.111351] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1592.614103] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1593.116588] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1593.116826] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1593.791090] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1593.791493] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1593.897734] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1593.897954] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1593.897954] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1593.898117] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1593.910562] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1593.911615] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1593.913140] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1593.953784] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1593.954088] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1593.954088] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1593.954209] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1593.969669] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1593.970600] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1593.970703] env[70392]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=70392) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1593.970765] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1594.004637] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1594.004932] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1594.004932] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1594.005133] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1594.005892] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1594.006086] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1594.087500] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1594.087764] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1594.087764] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1594.087937] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1594.088299] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1594.088618] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1594.173559] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1594.173794] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1594.173794] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1594.173957] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1594.174489] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1594.174817] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:31. [ 1594.174960] env[70392]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'2515ad2c-fd11-420c-a9b5-5e230c52781f', '95c32541-66a7-4f87-ab53-411ea5d5172e', '47a435cb-d815-4f84-b215-41c82faf33b9', '2e375ce9-a326-43ce-b62b-e40b371dfd91', '73f697c6-7f54-4f76-8856-ccf1651be1c2', 'db50a8fd-2283-44bb-910d-f7a2f2541f14', 'f0999f45-c89f-488f-b038-36a93b2cdeb4', '12100879-b33a-4e8b-8947-ed54d332f821', 'ac589e4e-a2e5-4716-8490-eecefc1b6a5e', '7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5', '4f7f8865-743f-4e67-8bf2-9a21ed1eaac4', 'e33b6cac-e9e7-4fe8-a87b-2dee2c42645e', 'e473c6e0-5940-4d57-ba2e-d012e6d8eeb9', 'bca01ddc-73d5-4856-bbff-aefad642492a', '2dfa1026-01a5-4176-a643-8ab1ceda5ce6', '839b66b0-e5ba-4f94-b08b-508956410270', '3507e503-4abd-47ec-8347-82fc9e691881', 'fcc3c75c-0cae-4c7c-8f32-6c948e76880d', 'c3e59ae3-629d-4146-9bee-ef9808a03841', '44698b7f-7125-46d0-837f-5d44d3ee1aea', '49e97029-e971-47d3-aa73-0fe54ba5d0b0', '438fa731-ac4f-4636-ae4b-8e30973002cd', '623be016-3395-49f1-ae71-2a2052cde818', 'cca6e4dd-68c9-4fd2-8e1a-cda645da02e4', 'c1385665-0c09-423f-98c4-4d6b46c66ec0', 'cecf942b-0f7e-4cdd-81a1-7f09ac513a05', '59adf132-72f4-4d43-847e-1af9bc3c6073', '56238df1-04a7-4a59-9d0f-ea911fb29f15', '03a8a1fe-a465-4403-8e2c-2170f54b59a0', 'fc49f827-a914-4b77-820c-bb2bf63c8bc7', 'ee8b641c-b2f7-4b94-85bb-98a31dba1604'} {{(pid=70392) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1594.175067] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1594.193766] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1594.193999] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1594.194141] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1594.194416] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1594.194597] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1594.194728] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1594.194844] env[70392]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=70392) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1594.195012] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1594.274974] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1594.275285] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1594.275285] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1594.275422] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1594.276764] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1594.277060] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1594.277145] env[70392]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=70392) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1594.277261] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1594.277335] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1594.277401] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/31 resources of Type:Security Group Rules [ 1594.277473] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2515ad2c-fd11-420c-a9b5-5e230c52781f with Priority: HIGH for action security_group_rules [ 1594.277539] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 95c32541-66a7-4f87-ab53-411ea5d5172e with Priority: HIGH for action security_group_rules [ 1594.277597] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 47a435cb-d815-4f84-b215-41c82faf33b9 with Priority: HIGH for action security_group_rules [ 1594.277667] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2e375ce9-a326-43ce-b62b-e40b371dfd91 with Priority: HIGH for action security_group_rules [ 1594.277731] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 73f697c6-7f54-4f76-8856-ccf1651be1c2 with Priority: HIGH for action security_group_rules [ 1594.277805] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: db50a8fd-2283-44bb-910d-f7a2f2541f14 with Priority: HIGH for action security_group_rules [ 1594.277887] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f0999f45-c89f-488f-b038-36a93b2cdeb4 with Priority: HIGH for action security_group_rules [ 1594.277936] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 12100879-b33a-4e8b-8947-ed54d332f821 with Priority: HIGH for action security_group_rules [ 1594.277980] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ac589e4e-a2e5-4716-8490-eecefc1b6a5e with Priority: HIGH for action security_group_rules [ 1594.278092] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 with Priority: HIGH for action security_group_rules [ 1594.278168] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 with Priority: HIGH for action security_group_rules [ 1594.278239] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e33b6cac-e9e7-4fe8-a87b-2dee2c42645e with Priority: HIGH for action security_group_rules [ 1594.278239] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 with Priority: HIGH for action security_group_rules [ 1594.278377] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bca01ddc-73d5-4856-bbff-aefad642492a with Priority: HIGH for action security_group_rules [ 1594.278377] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2dfa1026-01a5-4176-a643-8ab1ceda5ce6 with Priority: HIGH for action security_group_rules [ 1594.278520] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 839b66b0-e5ba-4f94-b08b-508956410270 with Priority: HIGH for action security_group_rules [ 1594.278520] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3507e503-4abd-47ec-8347-82fc9e691881 with Priority: HIGH for action security_group_rules [ 1594.278609] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fcc3c75c-0cae-4c7c-8f32-6c948e76880d with Priority: HIGH for action security_group_rules [ 1594.278609] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c3e59ae3-629d-4146-9bee-ef9808a03841 with Priority: HIGH for action security_group_rules [ 1594.278696] env[70392]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 44698b7f-7125-46d0-837f-5d44d3ee1aea with Priority: HIGH for action security_group_rules [ 1594.278800] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1598.792156] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1598.792534] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1598.792534] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2515ad2c-fd11-420c-a9b5-5e230c52781f with Priority: HIGH for action security_group_rules [ 1598.792534] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47a435cb-d815-4f84-b215-41c82faf33b9 with Priority: HIGH for action security_group_rules [ 1598.792648] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0999f45-c89f-488f-b038-36a93b2cdeb4 with Priority: HIGH for action security_group_rules [ 1598.792715] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2dfa1026-01a5-4176-a643-8ab1ceda5ce6 with Priority: HIGH for action security_group_rules [ 1598.792808] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44698b7f-7125-46d0-837f-5d44d3ee1aea with Priority: HIGH for action security_group_rules [ 1598.792900] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3e59ae3-629d-4146-9bee-ef9808a03841 with Priority: HIGH for action security_group_rules [ 1598.792999] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcc3c75c-0cae-4c7c-8f32-6c948e76880d with Priority: HIGH for action security_group_rules [ 1598.793105] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3507e503-4abd-47ec-8347-82fc9e691881 with Priority: HIGH for action security_group_rules [ 1598.793194] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bca01ddc-73d5-4856-bbff-aefad642492a with Priority: HIGH for action security_group_rules [ 1598.793281] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 839b66b0-e5ba-4f94-b08b-508956410270 with Priority: HIGH for action security_group_rules [ 1598.793368] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 with Priority: HIGH for action security_group_rules [ 1598.793466] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e33b6cac-e9e7-4fe8-a87b-2dee2c42645e with Priority: HIGH for action security_group_rules [ 1598.793583] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 with Priority: HIGH for action security_group_rules [ 1598.793689] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 with Priority: HIGH for action security_group_rules [ 1598.793792] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac589e4e-a2e5-4716-8490-eecefc1b6a5e with Priority: HIGH for action security_group_rules [ 1598.793863] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db50a8fd-2283-44bb-910d-f7a2f2541f14 with Priority: HIGH for action security_group_rules [ 1598.793948] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12100879-b33a-4e8b-8947-ed54d332f821 with Priority: HIGH for action security_group_rules [ 1598.794045] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73f697c6-7f54-4f76-8856-ccf1651be1c2 with Priority: HIGH for action security_group_rules [ 1598.794135] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95c32541-66a7-4f87-ab53-411ea5d5172e with Priority: HIGH for action security_group_rules [ 1598.794221] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e375ce9-a326-43ce-b62b-e40b371dfd91 with Priority: HIGH for action security_group_rules [ 1598.794567] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2515ad2c-fd11-420c-a9b5-5e230c52781f taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.794693] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2515ad2c-fd11-420c-a9b5-5e230c52781f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.794759] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2515ad2c-fd11-420c-a9b5-5e230c52781f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.794960] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2515ad2c-fd11-420c-a9b5-5e230c52781f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.795088] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2515ad2c-fd11-420c-a9b5-5e230c52781f',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1598.796097] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-47a435cb-d815-4f84-b215-41c82faf33b9 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.796222] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.796290] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.796464] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.796542] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('47a435cb-d815-4f84-b215-41c82faf33b9',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1598.798052] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f0999f45-c89f-488f-b038-36a93b2cdeb4 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.798052] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f0999f45-c89f-488f-b038-36a93b2cdeb4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.798052] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f0999f45-c89f-488f-b038-36a93b2cdeb4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.798052] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f0999f45-c89f-488f-b038-36a93b2cdeb4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.798052] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f0999f45-c89f-488f-b038-36a93b2cdeb4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1598.799145] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2dfa1026-01a5-4176-a643-8ab1ceda5ce6 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.799257] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2dfa1026-01a5-4176-a643-8ab1ceda5ce6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.799314] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2dfa1026-01a5-4176-a643-8ab1ceda5ce6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.799460] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2dfa1026-01a5-4176-a643-8ab1ceda5ce6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.799531] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2dfa1026-01a5-4176-a643-8ab1ceda5ce6',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1598.800499] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-44698b7f-7125-46d0-837f-5d44d3ee1aea taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.800605] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-44698b7f-7125-46d0-837f-5d44d3ee1aea" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.800693] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-44698b7f-7125-46d0-837f-5d44d3ee1aea" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.800815] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-44698b7f-7125-46d0-837f-5d44d3ee1aea" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.801138] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('44698b7f-7125-46d0-837f-5d44d3ee1aea',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1598.801943] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c3e59ae3-629d-4146-9bee-ef9808a03841 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.802060] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.802168] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.802267] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.802341] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c3e59ae3-629d-4146-9bee-ef9808a03841',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1598.803271] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fcc3c75c-0cae-4c7c-8f32-6c948e76880d taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.803435] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fcc3c75c-0cae-4c7c-8f32-6c948e76880d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.803435] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fcc3c75c-0cae-4c7c-8f32-6c948e76880d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.803694] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fcc3c75c-0cae-4c7c-8f32-6c948e76880d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.803755] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fcc3c75c-0cae-4c7c-8f32-6c948e76880d',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1598.804675] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3507e503-4abd-47ec-8347-82fc9e691881 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.804783] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.804851] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.805052] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.805160] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3507e503-4abd-47ec-8347-82fc9e691881',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1598.806306] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bca01ddc-73d5-4856-bbff-aefad642492a taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.806370] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.806399] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.806532] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.806596] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bca01ddc-73d5-4856-bbff-aefad642492a',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1598.807510] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-839b66b0-e5ba-4f94-b08b-508956410270 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.807620] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-839b66b0-e5ba-4f94-b08b-508956410270" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.807725] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-839b66b0-e5ba-4f94-b08b-508956410270" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.807814] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-839b66b0-e5ba-4f94-b08b-508956410270" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.807885] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('839b66b0-e5ba-4f94-b08b-508956410270',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1598.809061] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.809258] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.809331] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.809485] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.809577] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e473c6e0-5940-4d57-ba2e-d012e6d8eeb9',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1598.810277] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.810397] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.810475] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.810618] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.810691] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e33b6cac-e9e7-4fe8-a87b-2dee2c42645e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1598.811359] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.811463] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.811529] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.811675] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.811746] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4f7f8865-743f-4e67-8bf2-9a21ed1eaac4',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1598.812553] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.812603] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.812661] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.812810] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.812891] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1598.814348] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac589e4e-a2e5-4716-8490-eecefc1b6a5e taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.814447] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac589e4e-a2e5-4716-8490-eecefc1b6a5e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.814541] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac589e4e-a2e5-4716-8490-eecefc1b6a5e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.814666] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac589e4e-a2e5-4716-8490-eecefc1b6a5e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.814737] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac589e4e-a2e5-4716-8490-eecefc1b6a5e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1598.815953] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-db50a8fd-2283-44bb-910d-f7a2f2541f14 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.816306] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-db50a8fd-2283-44bb-910d-f7a2f2541f14" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.816403] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-db50a8fd-2283-44bb-910d-f7a2f2541f14" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.816567] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-db50a8fd-2283-44bb-910d-f7a2f2541f14" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.816625] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('db50a8fd-2283-44bb-910d-f7a2f2541f14',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1598.817545] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-12100879-b33a-4e8b-8947-ed54d332f821 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.817652] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-12100879-b33a-4e8b-8947-ed54d332f821" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.817719] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-12100879-b33a-4e8b-8947-ed54d332f821" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.818025] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-12100879-b33a-4e8b-8947-ed54d332f821" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.818025] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('12100879-b33a-4e8b-8947-ed54d332f821',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1598.818878] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-73f697c6-7f54-4f76-8856-ccf1651be1c2 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.818964] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-73f697c6-7f54-4f76-8856-ccf1651be1c2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.819024] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-73f697c6-7f54-4f76-8856-ccf1651be1c2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.819174] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-73f697c6-7f54-4f76-8856-ccf1651be1c2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.819251] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('73f697c6-7f54-4f76-8856-ccf1651be1c2',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1598.820326] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-95c32541-66a7-4f87-ab53-411ea5d5172e taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.820458] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-95c32541-66a7-4f87-ab53-411ea5d5172e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.820493] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-95c32541-66a7-4f87-ab53-411ea5d5172e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.820634] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-95c32541-66a7-4f87-ab53-411ea5d5172e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.820704] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('95c32541-66a7-4f87-ab53-411ea5d5172e',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1598.821717] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2e375ce9-a326-43ce-b62b-e40b371dfd91 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.821956] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2e375ce9-a326-43ce-b62b-e40b371dfd91" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.821956] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2e375ce9-a326-43ce-b62b-e40b371dfd91" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.822221] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2e375ce9-a326-43ce-b62b-e40b371dfd91" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.822321] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2e375ce9-a326-43ce-b62b-e40b371dfd91',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1598.847622] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.847802] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.847850] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.848078] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.867709] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1598.867871] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4f7f8865-743f-4e67-8bf2-9a21ed1eaac4 is going to be deleted. [ 1598.913807] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.914036] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.914036] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.914253] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.914346] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1598.914460] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4f7f8865-743f-4e67-8bf2-9a21ed1eaac4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1599.328152] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.328348] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.328348] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1599.328595] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1599.333565] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.333764] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.333764] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1599.333949] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1599.334120] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.334206] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.334263] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1599.334417] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1599.334494] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1599.334578] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1599.334665] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e473c6e0-5940-4d57-ba2e-d012e6d8eeb9',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1599.341266] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.341430] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.342582] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.342669] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.347228] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.347344] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.353339] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.353488] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.354185] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.354283] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.357867] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.357987] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.358683] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.358779] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.374469] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.374647] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.376972] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.377142] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.383873] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.384032] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.384961] env[70392]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1599.385508] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.385650] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.386185] env[70392]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1599.386583] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.386695] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.387279] env[70392]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1599.387695] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1599.387804] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f0999f45-c89f-488f-b038-36a93b2cdeb4 is going to be deleted. [ 1599.388667] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1599.388859] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1599.390294] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.390389] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.391065] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.391161] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.392359] env[70392]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1599.392714] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.392817] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.393466] env[70392]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1599.393831] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.393938] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.394499] env[70392]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1599.394859] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.394948] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.411754] env[70392]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1599.412274] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1599.412384] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fcc3c75c-0cae-4c7c-8f32-6c948e76880d is going to be deleted. [ 1599.413260] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1599.413466] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1599.430938] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1599.431095] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2dfa1026-01a5-4176-a643-8ab1ceda5ce6 is going to be deleted. [ 1599.431955] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1599.432180] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1599.440019] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.440195] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.450065] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1599.450186] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 44698b7f-7125-46d0-837f-5d44d3ee1aea is going to be deleted. [ 1599.451010] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1599.451226] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1599.469025] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.469202] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.474164] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1599.474286] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c3e59ae3-629d-4146-9bee-ef9808a03841 is going to be deleted. [ 1599.475205] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1599.475424] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1599.504286] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.504476] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.514014] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1599.514165] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 839b66b0-e5ba-4f94-b08b-508956410270 is going to be deleted. [ 1599.515106] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1599.515317] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1599.540467] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1599.540629] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bca01ddc-73d5-4856-bbff-aefad642492a is going to be deleted. [ 1599.541526] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1599.541751] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1599.550974] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.551129] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.572190] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.572388] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.573238] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1599.573372] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3507e503-4abd-47ec-8347-82fc9e691881 is going to be deleted. [ 1599.574231] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1599.574442] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1599.583789] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.583973] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.610489] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1599.610651] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac589e4e-a2e5-4716-8490-eecefc1b6a5e is going to be deleted. [ 1599.611595] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1599.611810] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1599.639547] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1599.639713] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: db50a8fd-2283-44bb-910d-f7a2f2541f14 is going to be deleted. [ 1599.640626] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1599.640843] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1599.685727] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.685933] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.706401] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.706608] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.710402] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1599.710571] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 73f697c6-7f54-4f76-8856-ccf1651be1c2 is going to be deleted. [ 1599.711475] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1599.711699] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1599.753924] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1599.754083] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e33b6cac-e9e7-4fe8-a87b-2dee2c42645e is going to be deleted. [ 1599.755047] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1599.755282] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1599.830435] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.830810] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.834293] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.834429] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.843937] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.844161] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.849496] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e473c6e0-5940-4d57-ba2e-d012e6d8eeb9',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1599.866854] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1599.867108] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2515ad2c-fd11-420c-a9b5-5e230c52781f is going to be deleted. [ 1599.867887] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1599.868129] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1599.945515] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.945775] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.953123] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1599.953312] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 95c32541-66a7-4f87-ab53-411ea5d5172e is going to be deleted. [ 1599.954198] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1599.954422] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.016120] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.016275] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5 is going to be deleted. [ 1600.017408] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.017636] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.073687] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1600.073877] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1600.074511] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1600.074616] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1600.091146] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.091367] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 47a435cb-d815-4f84-b215-41c82faf33b9 is going to be deleted. [ 1600.092212] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.092465] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.257465] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.257619] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2e375ce9-a326-43ce-b62b-e40b371dfd91 is going to be deleted. [ 1600.258523] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.258737] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.305079] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.305223] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 12100879-b33a-4e8b-8947-ed54d332f821 is going to be deleted. [ 1600.306245] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.306459] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.306553] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.306679] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f0999f45-c89f-488f-b038-36a93b2cdeb4" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.307500] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1600.307607] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1600.307678] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.307846] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.307929] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.308058] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-47a435cb-d815-4f84-b215-41c82faf33b9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.308741] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1600.308837] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1600.308905] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.309074] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.309157] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.309274] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7cb7ad0c-c10a-4cd2-9572-d3c7cc844cf5" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.309400] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.309544] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.309623] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.309737] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fcc3c75c-0cae-4c7c-8f32-6c948e76880d" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.310253] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.310429] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.310514] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.310652] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2dfa1026-01a5-4176-a643-8ab1ceda5ce6" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.310747] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.310892] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.310981] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.311109] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-44698b7f-7125-46d0-837f-5d44d3ee1aea" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.311257] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.311419] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.311498] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.311609] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c3e59ae3-629d-4146-9bee-ef9808a03841" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.311718] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.311852] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.311927] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.312049] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-839b66b0-e5ba-4f94-b08b-508956410270" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.312164] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.312304] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.312378] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.312488] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3507e503-4abd-47ec-8347-82fc9e691881" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.312622] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.312795] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.312873] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.312982] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bca01ddc-73d5-4856-bbff-aefad642492a" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.313107] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.313246] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.313320] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.313428] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-db50a8fd-2283-44bb-910d-f7a2f2541f14" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.313537] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.313677] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.313750] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.313860] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac589e4e-a2e5-4716-8490-eecefc1b6a5e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.313989] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.314154] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.314239] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.314337] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-73f697c6-7f54-4f76-8856-ccf1651be1c2" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.314446] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.314579] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.314652] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.314748] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e33b6cac-e9e7-4fe8-a87b-2dee2c42645e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.314857] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.314996] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.315105] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.315214] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2515ad2c-fd11-420c-a9b5-5e230c52781f" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.315349] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.315530] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.315611] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.315721] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-95c32541-66a7-4f87-ab53-411ea5d5172e" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.352302] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e473c6e0-5940-4d57-ba2e-d012e6d8eeb9: rpc.has_security_group_logging(os_id): False [ 1600.384422] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1600.384621] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1600.384658] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.384891] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.384987] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.385159] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2e375ce9-a326-43ce-b62b-e40b371dfd91" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.388672] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1600.388801] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1600.388868] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.389098] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.456214] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.456524] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1600.456653] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1600.456711] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.456925] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.457028] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.457107] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 is going to be updated. [ 1600.461724] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1600.461894] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1600.461946] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.462148] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.462239] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.462354] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-12100879-b33a-4e8b-8947-ed54d332f821" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.597303] env[70392]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1600.597876] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1600.598140] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1600.598230] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.598449] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.598597] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.619595] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 in Status: IN_PROGRESS for 2s [ 1602.634361] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 in Status: SUCCESS [ 1602.634718] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1603.795194] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1603.795194] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1608.796403] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1608.796807] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1613.797790] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1613.798027] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1618.799196] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1618.799544] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1623.800310] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1623.800705] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1628.801430] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1628.801809] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1630.254974] env[70392]: INFO networking_nsxv3.common.synchronization [req-c7676612-f022-4184-919e-ee0226d96854 req-db74cf04-7693-4197-ba9b-4540f318b930 tempest-ServerActionsTestJSON-648729814 tempest-ServerActionsTestJSON-648729814-project-member] Enqueued Resource ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 with Priority: HIGHEST for action security_group_members [ 1630.255830] env[70392]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 with Priority: HIGHEST for action security_group_members [ 1630.256294] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock member-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 taken with stack trace [, , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1630.256483] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1630.256611] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1630.256912] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1630.257174] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1630.257341] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1630.257457] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1630.257884] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1630.258054] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1630.258214] env[70392]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e473c6e0-5940-4d57-ba2e-d012e6d8eeb9',) {} {{(pid=70392) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1630.760784] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1630.760983] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1630.761046] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1630.761241] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1630.761332] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1630.761531] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1630.761629] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1630.761693] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1630.761839] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1630.761918] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1630.762013] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 is going to be updated. [ 1630.790865] env[70392]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70392) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1630.791079] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1630.791079] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1630.791292] env[70392]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1630.791435] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1630.800445] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 in Status: IN_PROGRESS for 2s [ 1632.811301] env[70392]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 in Status: SUCCESS [ 1632.811730] env[70392]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e473c6e0-5940-4d57-ba2e-d012e6d8eeb9 deletion is rescheduled due to dependency. [ 1632.811730] env[70392]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e473c6e0-5940-4d57-ba2e-d012e6d8eeb9" {{(pid=70392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1635.256843] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1635.257169] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1640.258493] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1640.258919] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1645.259889] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1645.260203] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1650.261220] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1650.261573] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1655.262414] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1655.262414] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1660.263461] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1660.263866] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1665.264872] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1665.265147] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1670.265667] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1670.265980] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1675.267033] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1675.267314] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1680.268418] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1680.268777] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1685.269872] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1685.269872] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1690.270603] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1690.270603] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1695.271379] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1695.271656] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1700.272675] env[70392]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1700.273000] env[70392]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0